Managing Audit Configurations

When you run an audit job, you specify a separate audit target and an audit configuration for the job.

By using separate target and configurations, you can create a configuration one time and reuse it multiple times with different targets. For example, you can create multiple targets and jobs with the same configuration to compare model.

Task Guides

Perform common audit target tasks.

Create a Basic Target

Create a new target

Basic Audit Target

Create a build.nvidia.com Target

Create a target for accessing models from integrate.api.nvidia.com.

Build.nvidia.com Model Target

Create a NeMo NIM Proxy Target

Create a target for accessing models from NeMo NIM Proxy.

platform

NeMo NIM Proxy Target

Create a Locally-Deployed NIM Target

Create a target for accessing models from a locally-deployed NIM for LLMs microservice.

standalone

Locally-Deployed NIM Microservice Target

Create a Target for OpenAI

Create a target for accessing models from api.openai.com.

OpenAI Model Target

Update and Delete Targets

Manage audit targets.

Updating and Deleting Audit Targets

References

Review detailed specifications for creating audit configurations.

Target Schema

Reference documentation for the JSON schema used to define audit configurations.

Schema for Audit Targets