nat.plugins.eval.cli.sizing#
Functions#
|
Estimate GPU count and plot metrics for a workflow profile. |
Sizing-related commands. |
Module Contents#
- calc_command(
- ctx,
- config_file,
- offline_mode,
- target_llm_latency,
- target_workflow_runtime,
- target_users,
- test_gpu_count,
- calc_output_dir,
- concurrencies,
- num_passes,
- append_calc_outputs,
- endpoint,
- endpoint_timeout,
Estimate GPU count and plot metrics for a workflow profile.
- sizing_command()#
Sizing-related commands.