nat.experimental.test_time_compute.models.search_config

Classes

SingleShotMultiPlanConfig
MultiLLMPlanConfig	Configuration for a 'multi LLM plan generation' strategy.
MultiQueryRetrievalSearchConfig	Configuration for the MultiQueryRetrievalSearch strategy.
MultiLLMGenerationConfig	Configuration for a 'multi LLM generation' strategy.

Module Contents

class SingleShotMultiPlanConfig

Bases: nat.data_models.ttc_strategy.TTCStrategyBaseConfig

num_plans: int = None

max_temperature: float = None

min_temperature: float = None

planning_llm: nat.data_models.component_ref.LLMRef | Any | None = None

planning_template: str = None

classmethod validate_strategies(values: dict[str, Any]) → dict[str, Any]

Ensure that the required LLMs are provided based on the selected strategies.

class MultiLLMPlanConfig

Bases: nat.data_models.ttc_strategy.TTCStrategyBaseConfig

Configuration for a ‘multi LLM plan generation’ strategy.

llms: list[nat.data_models.component_ref.LLMRef] = None

plans_per_llm: int = None

max_temperature: float = None

min_temperature: float = None

planning_template: str = None

classmethod validate_multi_llm_strategies(values: dict) → dict

class MultiQueryRetrievalSearchConfig

Bases: nat.data_models.ttc_strategy.TTCStrategyBaseConfig

Configuration for the MultiQueryRetrievalSearch strategy. This strategy generates multiple new ‘TTCItem’s per original item, each containing a differently phrased or re-focused version of the original task.

llms: list[nat.data_models.component_ref.LLMRef] = None

query_generation_template: str = None

classmethod validate_llms(values)

class MultiLLMGenerationConfig

Bases: nat.data_models.ttc_strategy.TTCStrategyBaseConfig

Configuration for a ‘multi LLM generation’ strategy.

llms: list[nat.data_models.component_ref.LLMRef] = None

generation_template: str = None

classmethod validate_config(values: dict) → dict