> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/curator/llms.txt.
> For full documentation content, see https://docs.nvidia.com/nemo/curator/llms-full.txt.

# nemo_curator.config.run

## Module Contents

### Functions

| Name                                                                                  | Description                                       |
| ------------------------------------------------------------------------------------- | ------------------------------------------------- |
| [`_instantiate_stage`](#nemo_curator-config-run-_instantiate_stage)                   | Instantiate a single stage from its Hydra config. |
| [`create_pipeline_from_yaml`](#nemo_curator-config-run-create_pipeline_from_yaml)     | -                                                 |
| [`create_ray_client_from_yaml`](#nemo_curator-config-run-create_ray_client_from_yaml) | -                                                 |
| [`main`](#nemo_curator-config-run-main)                                               | -                                                 |

### API

<Anchor id="nemo_curator-config-run-_instantiate_stage">
  <CodeBlock showLineNumbers={false} wordWrap={true}>
    ```python
    nemo_curator.config.run._instantiate_stage(
        stage_cfg: omegaconf.DictConfig
    ) -> typing.Any
    ```
  </CodeBlock>
</Anchor>

<Indent>
  Instantiate a single stage from its Hydra config.

  Extracts `resources` before calling `hydra.utils.instantiate`
  (it is applied via `.with_()`, not as a constructor argument) and
  re-applies it after construction. `batch_size` is left in the config
  dict so that stages declaring it as a dataclass field receive it
  during construction.
</Indent>

<Anchor id="nemo_curator-config-run-create_pipeline_from_yaml">
  <CodeBlock links={{"nemo_curator.pipeline.Pipeline":"/nemo-curator/nemo_curator/pipeline/pipeline#nemo_curator-pipeline-pipeline-Pipeline"}} showLineNumbers={false} wordWrap={true}>
    ```python
    nemo_curator.config.run.create_pipeline_from_yaml(
        cfg: omegaconf.DictConfig
    ) -> nemo_curator.pipeline.Pipeline | typing.Any
    ```
  </CodeBlock>
</Anchor>

<Indent />

<Anchor id="nemo_curator-config-run-create_ray_client_from_yaml">
  <CodeBlock links={{"nemo_curator.core.client.RayClient":"/nemo-curator/nemo_curator/core/client#nemo_curator-core-client-RayClient"}} showLineNumbers={false} wordWrap={true}>
    ```python
    nemo_curator.config.run.create_ray_client_from_yaml(
        cfg: omegaconf.DictConfig
    ) -> nemo_curator.core.client.RayClient
    ```
  </CodeBlock>
</Anchor>

<Indent />

<Anchor id="nemo_curator-config-run-main">
  <CodeBlock showLineNumbers={false} wordWrap={true}>
    ```python
    nemo_curator.config.run.main(
        cfg: omegaconf.DictConfig
    ) -> None
    ```
  </CodeBlock>
</Anchor>

<Indent />