Concepts#

Background for nemotron steps run byob/bfcl with the bfcl family: what the pieces are, and why they are arranged this way.

Start with Getting Started with Building Function-Calling Benchmarks if you have not produced a benchmark.parquet yet. These pages assume you have seen the pipeline run once.

Pipeline overview

Stage order from prepare through publication, what is checkpointed, and why the pipeline refuses configuration it will not honor.

Pipeline Overview
Pipeline worked example

Follow one missing-slot transfer-fee task from an abstract template through binding, conversation planning, executable replay, selection, and publication.

Follow One Task Through the Pipeline
The Oracle Pack

The unit of truth: its file layout, the certification tiers, the Gold gate, and why pack code runs in its own process.

The Oracle Pack
Authoring flows

Three ways to obtain a pack, one generation pipeline, and the two human authorization boundaries that a model cannot cross.

Authoring Flows
Evaluation

Trace and executable scoring, the gates that run before any inference, and why the evaluator never sees the gold trace as a prompt.

Evaluation

Where to Go Next#