
Description
Use when designing, configuring, running, or troubleshooting NeMo Agent Toolkit evaluations, datasets, evaluator selection, ATIF surfaces, quality gates, custom evaluators, and `nat eval`.
SKILL.md
NeMo Agent Toolkit Evaluation
Use this skill for measuring agent quality and behavior.
Workflow
- Decide the evaluation surface and output format.
- Decompose quality goals into separate evaluators.
- Choose built-in evaluators before writing custom evaluators.
- Keep datasets small and explicit for local validation.
- Run
nat evaland inspect generated artifacts.
References
references/operating-mode.mdreferences/methodology.mdreferences/agent-eval-framework.mdreferences/evaluation-surfaces.mdreferences/evaluation-contract.mdreferences/evaluators/references/code-patterns.md
More skills from the NeMo-Agent-Toolkit repository
View all 11 skillsnat-agent-configuration
configure and compose NeMo Agent Toolkit agents
Jul 14AgentsNVIDIAOrchestrationnat-installation
install and configure NeMo Agent Toolkit
Jul 14AgentsDeploymentNVIDIAnat-mcp-and-serving
serve and configure NeMo agent workflows
Jul 14AgentsFastAPIMCPNVIDIAnat-optimization
optimize agent workflows with NeMo
Jul 14AgentsNVIDIAOptimizationPerformancenat-path-checks
fix NeMo Agent Toolkit documentation path errors
Jul 14DebuggingDocumentationNVIDIAnat-telemetry
configure telemetry for NeMo Agent Toolkit
Jul 14LangfuseLangSmithNVIDIAObservability +1
More from NVIDIA
View publishernemoclaw-user-guide
retrieve NemoClaw documentation and configuration
NemoClaw
Jul 20DocumentationMCPSearchmcore-build-and-dependency
manage Megatron-LM development environments
Megatron-LM
Jul 14ContainersDeploymentPythonmcore-bump-base-image
update NVIDIA PyTorch base images
Megatron-LM
Jul 14CI/CDDeploymentmcore-cicd
manage CI/CD pipelines for Megatron-LM
Megatron-LM
Jul 14CI/CDDeploymentGitHubmcore-create-issue
investigate CI failures and create issues
Megatron-LM
Jul 14DebuggingGitHubTriagemcore-linting-and-formatting
lint and format Megatron-LM code
Megatron-LM
Jul 14Best PracticesCode Analysis