nat.plugins.langchain.dataset_loader.register

Classes

EvalDatasetLangSmithConfig

Load evaluation dataset from LangSmith by dataset ID or name.

Functions

register_langsmith_dataset_loader(config, builder)

Module Contents

class EvalDatasetLangSmithConfig

Bases: nat.data_models.dataset_handler.EvalDatasetBaseConfig

Load evaluation dataset from LangSmith by dataset ID or name.

model_config

dataset_id: str | None = None

dataset_name: str | None = None

input_key: str = 'input'

output_key: str = 'output'

split: str | None = None

as_of: str | None = None

limit: int | None = None

_require_id_or_name() → Self

parser() → tuple

async register_langsmith_dataset_loader(

config: EvalDatasetLangSmithConfig,

builder: nat.builder.builder.EvalBuilder,

)