ReferenceFull Library ReferenceNemo Voice AgentNemo Voice AgentEvaluationScenariosData

nemo_voice_agent.evaluation.scenarios.data.simple_qa

View as Markdown

Module Contents

Classes

NameDescription
SimpleQASimple QA scenario.
SimpleQA2Simple QA scenario with the answer to the question ‘What is 1 plus 1?’ as 2.
SimpleQA3Simple QA scenario where the user asks about the weather in San Francisco.

API

class nemo_voice_agent.evaluation.scenarios.data.simple_qa.SimpleQA()

Bases: Scenario

Simple QA scenario.

agent_actions
Actions
agent_persona
Persona
agent_resources
Resources
agent_task
Task
description
= 'Simple QA example scenario'
max_duration
= 60
name
= 'simple_qa_1'
reference_answer
success_signals
user_actions
Actions
user_persona
Persona
user_resources
Resources
user_task
Task
class nemo_voice_agent.evaluation.scenarios.data.simple_qa.SimpleQA2()

Bases: SimpleQA

Simple QA scenario with the answer to the question ‘What is 1 plus 1?’ as 2.

agent_persona
Persona
agent_resources
Resources
description
name
= 'simple_qa_2'
reference_answer
user_actions
Actions
user_persona
Persona
user_resources
Resources
user_task
Task
class nemo_voice_agent.evaluation.scenarios.data.simple_qa.SimpleQA3()

Bases: SimpleQA2

Simple QA scenario where the user asks about the weather in San Francisco.

agent_resources
Resources
description
= 'Simple QA example scenario.'
name
= 'simple_qa_3'
reference_answer
nemo_voice_agent.evaluation.scenarios.data.simple_qa.SimpleQA3.get_agent_prompt() -> str
nemo_voice_agent.evaluation.scenarios.data.simple_qa.SimpleQA3.get_user_prompt() -> str