nat.cli.commands.sizing.calc#

Attributes#

Functions#

calc_command(ctx, config_file, offline_mode, ...)

Estimate GPU count and plot metrics for a workflow profile.

Module Contents#

logger#
calc_command(
ctx,
config_file,
offline_mode,
target_llm_latency,
target_workflow_runtime,
target_users,
test_gpu_count,
calc_output_dir,
concurrencies,
num_passes,
append_calc_outputs,
endpoint,
endpoint_timeout,
)#

Estimate GPU count and plot metrics for a workflow profile.