synthetic.mixtral

Module Contents

Classes

Mixtral8x7BFormatter

Represents a way of formatting a conversation with an LLM such that it can response appropriately

API

class synthetic.mixtral.Mixtral8x7BFormatter

Bases: nemo_curator.services.conversation_formatter.ConversationFormatter

Represents a way of formatting a conversation with an LLM such that it can response appropriately

PROMPT_PREFIX

‘ [INST] \n’

static format_conversation(conv: list[dict]) → str

Formats a converstation between a user and assistant in the Mixtral-8x7B format described here: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1 Args: conv: A conversation between a user and assistant Returns: A conversation formatted as text