About Improving NVIDIA NeMo Agent Toolkit Workflows

NeMo Agent toolkit offers a variety of tools and techniques to improve workflows. This section provides guides on evaluating, profiling, optimizing, and scaling your workflows for better performance and efficiency.

• Evaluating Workflows - Validate and maintain accuracy of agentic workflows with built-in evaluation tools.

• Profiling and Performance Monitoring - Use the profiler to profile entire workflows down to the tool and agent level, track input/output tokens and timings, and identify bottlenecks.

• Optimizer Guide - Automatically tune the parameters and prompts of your agents, tools, and workflows to maximize performance, minimize cost, and increase accuracy.

• Sizing Calculator - Using the sizing calculator to estimate GPU cluster size requirements.

• Test Time Compute - Use composable pre-built or customizable strategies to scale agent execution at runtime and improve performance.

• Finetuning Harness - Leverage the finetuning harness for finetuning of agentic LLM workflows to iteratively improve agents through experience.