NVIDIA logo

Skill

nat-evaluation

run evaluations for NeMo Agent Toolkit

Published by NVIDIA Updated Jul 14
Covers Datasets Evals NVIDIA Quality Assurance

Description

Use when designing, configuring, running, or troubleshooting NeMo Agent Toolkit evaluations, datasets, evaluator selection, ATIF surfaces, quality gates, custom evaluators, and `nat eval`.

SKILL.md

NeMo Agent Toolkit Evaluation

Use this skill for measuring agent quality and behavior.

Workflow

  1. Decide the evaluation surface and output format.
  2. Decompose quality goals into separate evaluators.
  3. Choose built-in evaluators before writing custom evaluators.
  4. Keep datasets small and explicit for local validation.
  5. Run nat eval and inspect generated artifacts.

References

  • references/operating-mode.md
  • references/methodology.md
  • references/agent-eval-framework.md
  • references/evaluation-surfaces.md
  • references/evaluation-contract.md
  • references/evaluators/
  • references/code-patterns.md

© 2026 YourAI.tools. Every skill from an identity-verified publisher.

Independent catalog. Not affiliated with, endorsed by, or sponsored by Anthropic or any listed publisher. All trademarks belong to their respective owners.