> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/guardrails/llms.txt.
> For full documentation content, see https://docs.nvidia.com/nemo/guardrails/llms-full.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/guardrails/_mcp/server.

# nemoguardrails.eval.cli

## Module Contents

### Functions

| Name                                                            | Description                                                           |
| --------------------------------------------------------------- | --------------------------------------------------------------------- |
| [`_launch_ui`](#nemoguardrails-eval-cli-_launch_ui)             | Helper to launch a Streamlit UI.                                      |
| [`check_compliance`](#nemoguardrails-eval-cli-check_compliance) | Check the policy compliance of the interactions in the `output_path`. |
| [`run`](#nemoguardrails-eval-cli-run)                           | Run the interactions for an evaluation.                               |
| [`ui`](#nemoguardrails-eval-cli-ui)                             | Launches the Evaluation UI.                                           |

### Data

[`app`](#nemoguardrails-eval-cli-app)

### API

```python
nemoguardrails.eval.cli._launch_ui(
    script: str,
    port: int = 8501
)
```

Helper to launch a Streamlit UI.

```python
nemoguardrails.eval.cli.check_compliance(
    llm_judge: str = typer.Option(help='The name...,
    eval_config_path: str = typer.Option('config', '-e'...,
    output_path: typing.List[str] = typer.Option([], '-o', '--o...,
    policy_ids: typing.List[str] = typer.Option([], '-p', '--p...,
    verbose: bool = typer.Option(False, '-v', '...,
    force: bool = typer.Option(False, '-f', '...,
    disable_llm_cache: bool = typer.Option(default=False,...,
    reset: bool = typer.Option(default=False,...,
    parallel: int = typer.Option(1, '--parallel...
)
```

Check the policy compliance of the interactions in the `output_path`.

```python
nemoguardrails.eval.cli.run(
    eval_config_path: str = typer.Option('config', '-e'...,
    guardrail_config_path: str = typer.Option(None, '-g', '-...,
    output_path: str = typer.Option('', '-o', '--o...,
    output_format: str = typer.Option(default='json'...,
    parallel: int = typer.Option(1, '--parallel...
)
```

Run the interactions for an evaluation.

```python
nemoguardrails.eval.cli.ui(
    eval_config_path: str = typer.Option(default='confi...,
    output_path: typing.List[str] = typer.Option(default=[], he...
)
```

Launches the Evaluation UI.

```python
nemoguardrails.eval.cli.app = typer.Typer()
```