YourAI.tools
NVIDIA logo

Skill

vlm-configuration

configure Vision Language Models

Published by NVIDIA Updated Jul 14
Covers LLM NVIDIA AI Infrastructure

Description

Configure the Vision Language Model (VLM) used for analyzing experiment plots. Use when the user asks to change the VLM provider or model, adjust temperature or max_tokens, enable or disable thinking mode, or troubleshoot VLM-related behavior in config.yaml.

SKILL.md

VLM Configuration

The VLM (Vision Language Model) is configured in config.yaml under the vlm section.

Config Location

config.yaml (in the project root)

Current Config Structure

vlm:
  provider: "nvidia"
  model: "nvidia/ising-calibration-1-35b-a3b"
  api_key_env: "NVIDIA_API_KEY"
  temperature: 0.2
  max_tokens: 32768
  enable_thinking: false

Supported Models (NVIDIA API)

ModelProviderNotes
nvidia/ising-calibration-1-35b-a3bNVIDIADefault, fine-tuned for calibration
google/gemma-4-31b-itGoogleGeneral-purpose 31B
meta/llama-3.2-90b-vision-instructMetaMost capable
meta/llama-3.2-11b-vision-instructMetaBalanced
microsoft/phi-3.5-vision-instructMicrosoftLightweight

Environment Variables

The VLM uses NVIDIA_API_KEY (same key as the main LLM).

To Change VLM

  1. Read current config.yaml
  2. Edit the vlm section with new values
  3. Changes take effect immediately on next vlm_inspect call (no restart needed)
AboutPrivacy PolicyTerms and Conditions

© 2026 YourAI.tools. Every skill from an identity-verified publisher.

Independent catalog. Not affiliated with, endorsed by, or sponsored by Anthropic or any listed publisher. All trademarks belong to their respective owners.