[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill-nvidia-vss-deploy-profile":3,"mdc--6j325w-key":31,"related-org-nvidia-vss-deploy-profile":3434,"related-repo-nvidia-vss-deploy-profile":3591},{"slug":4,"name":4,"fn":5,"description":6,"org":7,"tags":11,"stars":20,"repoUrl":21,"updatedAt":22,"license":23,"forks":24,"topics":25,"repo":26,"sourceUrl":29,"mdContent":30},"vss-deploy-profile","deploy and configure VSS profiles","Use to select, configure, deploy, verify, debug, or tear down a VSS profile (base, search, lvs, warehouse, edge). Not for standalone microservices — use the vss-deploy-* skill.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},"nvidia","NVIDIA","https:\u002F\u002Fpexgzepcugksgbtrxkhf.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Forg-logos\u002Fnvidia.png",[12,16,19],{"name":13,"slug":14,"type":15},"Configuration","configuration","tag",{"name":17,"slug":18,"type":15},"Deployment","deployment",{"name":9,"slug":8,"type":15},2473,"https:\u002F\u002Fgithub.com\u002FNVIDIA\u002Fskills","2026-07-17T05:28:59.916847","Apache-2.0",281,[],{"repoUrl":21,"stars":20,"forks":24,"topics":27,"description":28},[],"AI agent skills published by NVIDIA","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002Fskills\u002Ftree\u002FHEAD\u002Fskills\u002Fvss-deploy-profile","---\nname: vss-deploy-profile\ndescription: Use to select, configure, deploy, verify, debug, or tear down a VSS profile (base, search, lvs, warehouse, edge). Not for standalone microservices — use the vss-deploy-* skill.\nlicense: Apache-2.0\nmetadata:\n  version: \"3.2.0\"\n  github-url: \"https:\u002F\u002Fgithub.com\u002FNVIDIA-AI-Blueprints\u002Fvideo-search-and-summarization\"\n  tags: \"nvidia blueprint deployment\"\n---\n# VSS Deploy\n\n## Available Scripts\n\n| Script | Purpose | Arguments |\n|---|---|---|\n| `scripts\u002Fnormalize_resolved_yml.py` | Strip optional `depends_on` entries for services filtered out of `resolved.yml` before deploy. | Path to `resolved.yml` |\n| `scripts\u002Fprobe_remote_models.sh` | Probe an OpenAI-compatible remote LLM\u002FVLM endpoint and verify the selected model id. | Base URL, optional expected model id |\n\n## Profile Routing\n\nMatch the user's request to a profile, then load that profile's reference for sizing, services, env recipes, and debugging.\n\n| User says | Profile | Reference |\n|---|---|---|\n| \"deploy vss\" \u002F \"deploy base\" | `base` | [`references\u002Fbase.md`](references\u002Fbase.md) |\n| \"deploy alerts\" \u002F \"alert verification\" \u002F \"real-time alerts\" \u002F \"deploy for incident report\" | `alerts` | [`references\u002Falerts.md`](references\u002Falerts.md) |\n| \"deploy lvs\" \u002F \"video summarization\" | `lvs` | [`references\u002Flvs-profile.md`](references\u002Flvs-profile.md) |\n| \"deploy search\" \u002F \"video search\" | `search` | [`references\u002Fsearch.md`](references\u002Fsearch.md) |\n| \"deploy warehouse\" \u002F \"warehouse blueprint\" \u002F \"vss warehouse\" | `warehouse` | [`references\u002Fwarehouse.md`](references\u002Fwarehouse.md) |\n| \"debug warehouse\" \u002F \"warehouse not working\" \u002F \"warehouse FPS low\" \u002F \"warehouse BEV out of sync\" | `warehouse` (debug) | [`references\u002Fwarehouse-debug.md`](references\u002Fwarehouse-debug.md) |\n\n**Edge hardware routing** (DGX Spark, AGX\u002FIGX Thor): see [`references\u002Fedge.md`](references\u002Fedge.md). DGX Spark uses the Spark Nano 9B standalone local LLM on port `30081`; AGX\u002FIGX Thor uses the Edge 4B standalone vLLM fallback.\n\n**Each profile's reference owns its sizing table.** Don't pick a deployment shape from this file — open the profile reference and check minimum GPU count for the host's hardware against the (mode × platform) matrix there.\n\n## Instructions\n\nThe deployment flow is always: copy `.env` to `generated.env`, apply overrides, dry-run compose into `resolved.yml`, review, normalize, deploy, then wait for readiness.\n\n```bash\n# 1. cp dev-profile-\u003Cprofile>\u002F.env dev-profile-\u003Cprofile>\u002Fgenerated.env  (clean copy)\n# 2. Apply env overrides to generated.env  (source .env stays untouched)\n# 3. docker compose --env-file generated.env config > resolved.yml      (dry-run)\n# 4. Review resolved.yml\n# 5. docker compose --env-file generated.env -f resolved.yml up -d\n```\n\n`.env` is read-only checked-in defaults; `generated.env` is the per-deploy working copy. Step 1c covers this in full.\n\n## Prerequisites\n\n1. **Repo path** — auto-detect `video-search-and-summarization\u002F` before\n   asking the user. Use the detected path as `$REPO` for all subsequent\n   commands.\n2. **Credential gates** — see [`references\u002Fcredentials.md`](references\u002Fcredentials.md): `NGC_CLI_API_KEY` for local\u002Flocal_shared NIM pulls, `NVIDIA_API_KEY` for remote NIM endpoints, and `HF_TOKEN` for edge recipes that use gated HF models.\n3. **System prerequisites (GPU driver, Docker, NVIDIA Container Toolkit, kernel sysctls, and — if `ufw` is active — the [Docker-bridge→host firewall allow](references\u002Fprerequisites.md#firewall) so bridge NIMs can fetch clips from host-mode VST)** — full checks in [`references\u002Fprerequisites.md`](references\u002Fprerequisites.md). Canonical hardware\u002Fdriver matrix is the [VSS prerequisites page](https:\u002F\u002Fdocs.nvidia.com\u002Fvss\u002F3.2.0\u002Fprerequisites.html).\n\nThe auto-detect snippet (git-root, then a common-path probe gated on\n`deploy\u002Fdocker\u002Fcompose.yml` + `dev-profile.sh` + `skills\u002Fvss-deploy-profile`)\nlives in [`references\u002Fprerequisites.md`](references\u002Fprerequisites.md#repo-detect).\nExport the resolved `$REPO`; if detection fails, ask the user for the checkout path.\n\n### Pre-flight check\n\nRun before every deploy. The full system checklist and remediation steps live\nin [`references\u002Fprerequisites.md`](references\u002Fprerequisites.md#preflight).\nFor DGX Spark \u002F IGX Thor \u002F AGX Thor, also run the cache-cleaner check in\n[`references\u002Fedge.md`](references\u002Fedge.md#cache-cleaner-every-edge-deploy).\n\n**Detect sudo mode first.** Several pre-flight remediations and the\nedge cache-cleaner installer call `sudo`. If the host requires a\nsudo password, those steps will silently no-op under `sudo -n` and\nleave the deploy in a half-prepared state.\n\n```bash\nif sudo -n true 2>\u002Fdev\u002Fnull; then\n  echo \"passwordless sudo — pre-flight will auto-install missing pieces\"\nelse\n  echo \"sudo requires password — pre-flight will NOT auto-install; hand commands to the user\"\nfi\n```\n\nWhen sudo needs a password, the skill **must not** run privileged\ninstallers itself. Surface the copy-pasteable command block from\n`references\u002Fprerequisites.md` to the user with a *\"run this once and\nconfirm\"* handoff, then resume after the user replies.\n\nMinimum smoke test (must succeed):\n\n```bash\nnvidia-smi --query-gpu=index,name --format=csv,noheader\ndocker info 2>\u002Fdev\u002Fnull | grep -qi runtimes \\\n  && docker run --rm --gpus all ubuntu:22.04 nvidia-smi >\u002Fdev\u002Fnull 2>&1 \\\n  && echo \"nvidia runtime OK\"\n```\n\nIf the smoke test fails, do not proceed; open\n[`references\u002Fprerequisites.md`](references\u002Fprerequisites.md#preflight)\nfor the remediation tree.\n\n## Model Selection\n\n- `$LLM_REMOTE_URL` \u002F `$VLM_REMOTE_URL` if the user asks for remote\n- `$NGC_CLI_API_KEY` (local NIMs) or `$NVIDIA_API_KEY` (remote)\n\n**Endpoint intent gate.** Don't infer remote placement from stray env vars\n(`LLM_ENDPOINT_URL`, `VLM_ENDPOINT_URL`, `LLM_BASE_URL`, `VLM_BASE_URL` may be\nleftovers). Use remote LLM\u002FVLM only when (1) the user asked for \u002F supplied a\nremote endpoint, (2) local sizing can't fit the selected models and the user\nagrees, or (3) an edge recipe needs a standalone local service VSS treats as\n`remote` (e.g. DGX Spark Nano 9B on `localhost:30081`). If an endpoint var is\nset but the user didn't ask for remote, surface it in Step 1 and ask — never\nsilently deploy remote because a var happened to exist.\n\nIf no combination on this host satisfies the profile's sizing requirements, **stop and report the blocker** — don't silently pick another shape.\n\n> **Edge shared mode is platform-specific.** Full recipes are in [`references\u002Fedge.md`](references\u002Fedge.md).\n\n## Deployment Flow\n\nAlways follow this sequence. Never skip the dry-run.\n\n### Step 0 — Tear down any existing deployment + clear data volumes\n\nIf a deployment already exists, tear it down AND clear stale data volumes before redeploying. \n\nFull procedure lives in [`references\u002Fteardown.md`](references\u002Fteardown.md).\n\n### Step 0a — Credentials gate (run before any env mutation)\n\nValidate every credential and selected remote endpoint the chosen profile\nneeds **before** Step 1c copies `.env` to `generated.env`. A 401 here is a\n30-second failure; the same 401 inside a NIM cold-start is a 10–20 min\nfailure. Run the discovery and probe flow in\n[`references\u002Fcredentials.md`](references\u002Fcredentials.md), including\n`scripts\u002Fprobe_remote_models.sh` for any LLM\u002FVLM endpoint you plan to write\ninto `generated.env`. Map the result against the chosen mode: missing\nor invalid required credentials\u002Fendpoints are blockers, optional credentials\nare not.\n\n### Step 1 — Gather context\n\nBefore building env overrides, confirm:\n\n| Value | How to determine |\n|---|---|\n| **Profile** | Match user intent to the routing table above. Default: `base` |\n| **Repo path** | Use the `$REPO` value auto-detected in prerequisites. If auto-detect failed, ask the user for the checkout path before continuing. |\n| **Hardware** | `nvidia-smi --query-gpu=name,memory.total --format=csv,noheader` |\n| **LLM\u002FVLM placement** | Explicitly decide local \u002F local_shared \u002F remote. Cross-reference available GPUs against the chosen profile's **Minimum GPU count** table. If endpoint env vars are present but the user did not request remote, ask whether to use or ignore them. |\n| **API keys** | `NGC_CLI_API_KEY` for local NIMs, `NVIDIA_API_KEY` for remote |\n| **`HOST_IP`** | In-cluster dial address: `ip route get 1.1.1.1` src (like `dev-profile.sh`; correct on LAN + cloud). If that interface is a VPN\u002Ftunnel, fall back to the LAN IP and **prompt the user** — [Network addressing](references\u002Fprerequisites.md#addressing). |\n| **`EXTERNAL_IP`** | Browser-facing address; defaults to `${HOST_IP}`. Override when the browser path differs — cloud public IP, Brev secure-link (Step 1d), or tunnel; **ask the user where they browse from if unsure**. [Network addressing](references\u002Fprerequisites.md#addressing). |\n| **`HAPROXY_PORT`** | Browser-facing ingress port. Default `7777`; ensure it is free. |\n\nBefore `docker compose up`, verify `EXTERNAL_IP`, `HAPROXY_PORT`, `VSS_PUBLIC_HOST`, and `VSS_PUBLIC_PORT` are populated with browser-reachable values. Otherwise the stack may appear healthy while UI\u002FAPI\u002FVST links 404 or loop through Cloudflare Access.\n\n### Step 1b — Prepare the data directory\n\nLayout (asset paths, ownership, mount points, profile-specific subdirs) is documented in [`references\u002Fdata-directory.md`](references\u002Fdata-directory.md). Read that file before deploying for the first time on a host or when changing profiles.\n\n\n### Step 1c — Initialize `generated.env`\n\nThe skill's per-deploy working copy. Always start from a fresh copy of the source `.env` , never mutate the source.\n\n```bash\nPROFILE=base\nENV_SRC=$REPO\u002Fdeploy\u002Fdocker\u002Fdeveloper-profiles\u002Fdev-profile-$PROFILE\u002F.env\nENV_GEN=$REPO\u002Fdeploy\u002Fdocker\u002Fdeveloper-profiles\u002Fdev-profile-$PROFILE\u002Fgenerated.env\n\ncp \"$ENV_SRC\" \"$ENV_GEN\"\n```\n\nAll subsequent writes (Brev `EXTERNAL_IP`, the env_overrides dict from Step 2) go to `$ENV_GEN`. `$ENV_SRC` is read-only from here on.\n\n### Step 1d — Brev only: detect first, then set `EXTERNAL_IP` to the secure-link domain\n\n**Detect Brev before anything else** — a Brev-provisioned instance sets `BREV_ENV_ID` in `\u002Fetc\u002Fenvironment`; nothing else does:\n\n```bash\ngrep -qE '^BREV_ENV_ID=' \u002Fetc\u002Fenvironment && echo \"on Brev\" || echo \"not Brev\"\n```\n\n- **not Brev** → skip the rest of this step and **do not read [`references\u002Fbrev.md`](references\u002Fbrev.md)**; keep the normal `${HOST_IP}`-based `EXTERNAL_IP`.\n- **on Brev** → apply the Brev secure-link overrides from [`references\u002Fbrev.md` § Setup flow](references\u002Fbrev.md#setup-flow) to `generated.env` (NOT `.env`). Those set `EXTERNAL_IP` \u002F `VSS_PUBLIC_HOST` to the secure-link domain **and** `VSS_PUBLIC_HTTP_PROTOCOL=https` \u002F `VSS_PUBLIC_WS_PROTOCOL=wss` \u002F `VSS_PUBLIC_PORT=443` — setting `EXTERNAL_IP` alone leaves `http:\u002F\u002F…:7777` UI\u002FAPI\u002FWS links that the browser blocks as mixed content.\n\n### Step 2 — Build env_overrides\n\nProduce an `env_overrides` dict from the user request and the gathered\ncontext: explicitly choose remote\u002Flocal LLM\u002FVLM, set credentials, point at\nendpoints, set platform-specific flags. Do not let existing shell env vars\nsilently pick placement; write the selected `LLM_MODE` \u002F `VLM_MODE` and\nmatching endpoint\u002Fmodel fields into `generated.env`. The full mapping (every\noverride key, when it applies, defaults, profile-specific differences) lives\nin [`references\u002Fenv-overrides.md`](references\u002Fenv-overrides.md). Each profile\nreference has worked examples for that profile's common scenarios.\n\n\n### Step 3 — Apply overrides + dry-run\n\n**Working env file:** `\u003Crepo>\u002Fdeploy\u002Fdocker\u002Fdeveloper-profiles\u002Fdev-profile-\u003Cprofile>\u002Fgenerated.env` (created in Step 1c).\n\n> **Reminder (see Step 1c):** apply all overrides (Step 2 dict + Brev `EXTERNAL_IP`) to `generated.env`; `--env-file` always points at it, and post-deploy verifiers read it for the actually-deployed values.\n\n```bash\n# (Step 1c already ran: cp $ENV_SRC $ENV_GEN)\n\n# Apply the env_overrides dict from Step 2 to generated.env\n# (read lines, update matching keys, append new keys, write)\n# Example:\n#   sed -i \"s|^LLM_MODE=.*|LLM_MODE=remote|\" \"$ENV_GEN\"\n#   sed -i \"s|^LLM_BASE_URL=.*|LLM_BASE_URL=http:\u002F\u002Flocalhost:30081|\" \"$ENV_GEN\"\n\n# Resolve compose\ncd $REPO\u002Fdeploy\u002Fdocker\ndocker compose --env-file $ENV_GEN config > resolved.yml\n```\n\nThe resolved YAML is saved to `\u003Crepo>\u002Fdeploy\u002Fdocker\u002Fresolved.yml`.\n\n### Step 3b — Verify resolved.yml has no unexpanded ${...} tokens\n\nUnexpanded `${VAR}` tokens in `resolved.yml` mean compose did not see those env values. Diagnostic procedure and common culprits live in [`references\u002Ftroubleshooting.md`](references\u002Ftroubleshooting.md).\n\n\n### Step 3c — Verify access to selected NGC artifacts\n\nDo this after `resolved.yml` exists and before `docker compose up`. The NGC\ntoken probe in Step 0a proves only that the key authenticates; it does not\nprove the key's org\u002Fteam can access the selected image or model repositories.\n\nBuild the artifact list from the actual selected deployment:\n\n- `resolved.yml`: every `image:` under `nvcr.io\u002F...` that Compose will pull.\n- `$ENV_GEN`: NGC-backed model\u002Fresource paths such as\n  `RTVI_VLM_MODEL_PATH=ngc:nim\u002Fnvidia\u002Fcosmos3-nano-reasoner:bf16-final`. Skip\n  `none`, `git:...`, local paths, and remote endpoint URLs.\n- Profile staging steps: any NGC model\u002Fresource downloads documented in the\n  profile reference, such as alerts\u002Fsearch perception model staging.\n\nProbe each selected artifact with the normalized NGC key before continuing:\n\n- Container images: `docker manifest inspect \u003Cnvcr.io\u002F...>` after `docker\n  login nvcr.io` — for gated `nvcr.io` repos a `401`\u002F`403` here is a definitive\n  no-entitlement signal (manifest read requires the same org\u002Fteam grant as the\n  layer pull); or the matching `ngc registry image info ...` when the artifact\n  maps cleanly to an NGC image path.\n- NGC model\u002Fresource paths (e.g. the Cosmos checkpoint RT-VLM downloads at\n  runtime): run the matching `ngc registry model info ...` or `ngc registry\n  resource info ...` for the exact repo\u002Ftag the profile will load or download;\n  these use NGC's scoped auth. Do NOT probe a model with `docker manifest\n  inspect` (returns \"no such manifest\" because a model is not an OCI image) or a\n  raw `Authorization: Bearer \u003Ckey>` REST call (returns `403` because that is not\n  NGC's auth flow); both are expected false negatives, not entitlement failures.\n  If the `ngc` CLI is unavailable, treat the container-image probe above as the\n  entitlement signal, since NGC grants org\u002Fteam access across images and models\n  together.\n- Profile-staged TAO\u002Fperception models: run the corresponding `ngc registry\n  model info ...` \u002F `resource info ...` for each repo\u002Ftag before the staging\n  block downloads files.\n\nIf any probe returns `401`, `403`, `permission`, `not being a member of the\norganization that owns the repo`, missing org\u002Frepo, or a similar access error,\nstop and prompt the user for an NGC key from an org\u002Fteam entitled to those\nartifacts. Do not start Compose and discover the failure during NIM cold start.\n\n### Step 3d — Strip dangling optional `depends_on` from resolved.yml\n\n\n**MUST run after Step 3, before Step 5.** Skipping this aborts the deploy:\n\nNormalize - drop optional dependencies for services filtered out from resolved.yml\n\n```bash\n# From the repo root\nuv run skills\u002Fvss-deploy-profile\u002Fscripts\u002Fnormalize_resolved_yml.py \"$REPO\u002Fdeploy\u002Fdocker\u002Fresolved.yml\"\n```\nIf `uv` isn't on the host, install it once with `curl -LsSf https:\u002F\u002Fastral.sh\u002Fuv\u002Finstall.sh | sh` (no root needed).\n**Re-validate** before `up -d`:\n\n```bash\ndocker compose -f \"$REPO\u002Fdeploy\u002Fdocker\u002Fresolved.yml\" config --quiet && echo \"resolved.yml OK\"\n```\n\nIf validation still fails after the normalizer runs, capture the error and inspect — that's a different bug (a dependency that's not optional, or another schema violation), not the dangling-depends_on case.\n\n### Step 4 — Review\n\nShow the user a summary of what will be deployed:\n\n- Profile name and hardware\n- LLM\u002FVLM models and mode (local\u002Fremote\u002Flocal_shared)\n- Services that will start\n- GPU device assignment\n- Key endpoints (UI port, agent port)\n\nAsk: **\"Looks good — deploy now?\"** and wait for confirmation before Step 5.\n\n**Exception — autonomous mode.** If the user's request already asks you to run autonomously (e.g. \"deploy X autonomously\", \"run without confirmation\", \"non-interactive\"), skip the confirmation prompt and proceed straight to Step 5. This path exists so automated eval \u002F CI invocations don't hang waiting for a human reply they'll never get. In all other cases, a human must approve.\n\n### Step 5 — Deploy\n\n```bash\ncd $REPO\u002Fdeploy\u002Fdocker\ndocker compose --env-file $ENV_GEN -f resolved.yml up -d\n```\n\n> **`--env-file` is mandatory.** Without the same `generated.env` used in Step 3, `COMPOSE_PROFILES` may be unset and `up -d` can exit 0 with zero selected services.\n\n> **Avoid broad `--force-recreate` on ordinary retries** — it destroys warm\n> NIM containers (another 3–5 min torch.compile + CUDA-graph capture each).\n> Fix the root cause (usually perms or an env typo) and just re-run `up -d`;\n> use targeted `--force-recreate --no-deps \u003Cservice...>` only when a profile\n> reference documents it as the recovery path.\n\n`docker compose up -d` only creates containers; it does not wait for internal services to finish warming. Never declare deploy success until the readiness gates pass.\n\n### Step 5b — Wait until the stack is actually healthy\n\n**Gate 0 — container count must be > 0.** Refuse to proceed past `up -d` until the started count (`docker compose -f resolved.yml ps -q | wc -l`) is non-zero and ≥ the expected count (`config --services | wc -l`); a zero\u002Fshort count almost always means a missing `--env-file` in Step 5. The exact gate plus the full readiness procedure live in [`references\u002Freadiness.md`](references\u002Freadiness.md).\n\nCold deploys can take 10–20 min, and each profile reference lists the required endpoints. **Never declare deploy done after `up -d`; only after every documented endpoint succeeds.**\n\n## Tear Down\n\nTo tear down a deployment — full host reclaim or cache-preserving redeploy \u002F profile\nswitch — follow [`references\u002Fteardown.md`](references\u002Fteardown.md). Always tear down\nby the `mdx` project with `-v --remove-orphans`; a plain `docker compose down` leaves\nvolumes and networks behind.\n\n## Debugging a Deployment\n\nUse this workflow when the user asks to \"debug the deploy\", \"verify it's working\", \"why is the agent not responding\", or similar. The goal is to confirm the full video-ingestion-to-agent-answer path, not just that containers are \"Up\".\n\nEach profile reference has a **Debugging** section listing the exact commands and failure-mode table for that profile.\n\n### Quick checks (all profiles)\n\n```bash\n# 1. All expected containers Up\ndocker ps --format 'table {{.Names}}\\t{{.Status}}'\n\n# 2. Agent API + UI responding\ncurl -sf http:\u002F\u002Flocalhost:8000\u002Fhealth >\u002Fdev\u002Fnull && echo \"agent OK\"\ncurl -sf http:\u002F\u002Flocalhost:3000\u002F >\u002Fdev\u002Fnull && echo \"ui OK\"\n```\n\nThe LLM\u002FVLM NIM probes — including the `*_MODE=remote` handling that skips\n`localhost:3008x` (where a connection refused is expected) and probes the\nselected `*_BASE_URL\u002Fv1\u002Fmodels` via `scripts\u002Fprobe_remote_models.sh` — are in\n[`references\u002Ftroubleshooting.md`](references\u002Ftroubleshooting.md#nim-probes).\n\n## Limitations\n\n- This skill deploys compose-based VSS profiles only; standalone microservice deployment belongs to the matching `vss-deploy-*` skill.\n- Hardware sizing, model placement, and profile-specific readiness are owned by profile references; do not infer them from memory.\n- Privileged host remediation requires user approval when passwordless sudo is unavailable.\n\n## Troubleshooting\n\nThe common-error quick reference, the full symptom → cause → fix table, the\nunexpanded-`${...}` diagnostic, and the NIM endpoint probes are consolidated in\n[`references\u002Ftroubleshooting.md`](references\u002Ftroubleshooting.md) — start there\nfor any deploy, runtime, or probe failure, then continue in the matching\nper-profile reference's Debugging section.\n",{"data":32,"body":37},{"name":4,"description":6,"license":23,"metadata":33},{"version":34,"github-url":35,"tags":36},"3.2.0","https:\u002F\u002Fgithub.com\u002FNVIDIA-AI-Blueprints\u002Fvideo-search-and-summarization","nvidia blueprint deployment",{"type":38,"children":39},"root",[40,49,56,155,161,167,370,400,410,416,444,503,520,526,649,695,702,728,754,868,895,900,1058,1073,1079,1121,1177,1189,1212,1218,1223,1229,1234,1249,1255,1304,1310,1315,1567,1608,1614,1630,1641,1653,1782,1807,1820,1846,1930,2063,2069,2115,2121,2138,2173,2310,2322,2328,2358,2364,2383,2388,2455,2460,2587,2619,2632,2642,2647,2696,2731,2801,2806,2812,2817,2845,2857,2867,2873,2934,2974,3010,3021,3027,3077,3094,3100,3139,3145,3150,3162,3168,3321,3367,3373,3399,3405,3428],{"type":41,"tag":42,"props":43,"children":45},"element","h1",{"id":44},"vss-deploy",[46],{"type":47,"value":48},"text","VSS Deploy",{"type":41,"tag":50,"props":51,"children":53},"h2",{"id":52},"available-scripts",[54],{"type":47,"value":55},"Available Scripts",{"type":41,"tag":57,"props":58,"children":59},"table",{},[60,84],{"type":41,"tag":61,"props":62,"children":63},"thead",{},[64],{"type":41,"tag":65,"props":66,"children":67},"tr",{},[68,74,79],{"type":41,"tag":69,"props":70,"children":71},"th",{},[72],{"type":47,"value":73},"Script",{"type":41,"tag":69,"props":75,"children":76},{},[77],{"type":47,"value":78},"Purpose",{"type":41,"tag":69,"props":80,"children":81},{},[82],{"type":47,"value":83},"Arguments",{"type":41,"tag":85,"props":86,"children":87},"tbody",{},[88,133],{"type":41,"tag":65,"props":89,"children":90},{},[91,102,123],{"type":41,"tag":92,"props":93,"children":94},"td",{},[95],{"type":41,"tag":96,"props":97,"children":99},"code",{"className":98},[],[100],{"type":47,"value":101},"scripts\u002Fnormalize_resolved_yml.py",{"type":41,"tag":92,"props":103,"children":104},{},[105,107,113,115,121],{"type":47,"value":106},"Strip optional ",{"type":41,"tag":96,"props":108,"children":110},{"className":109},[],[111],{"type":47,"value":112},"depends_on",{"type":47,"value":114}," entries for services filtered out of ",{"type":41,"tag":96,"props":116,"children":118},{"className":117},[],[119],{"type":47,"value":120},"resolved.yml",{"type":47,"value":122}," before deploy.",{"type":41,"tag":92,"props":124,"children":125},{},[126,128],{"type":47,"value":127},"Path to ",{"type":41,"tag":96,"props":129,"children":131},{"className":130},[],[132],{"type":47,"value":120},{"type":41,"tag":65,"props":134,"children":135},{},[136,145,150],{"type":41,"tag":92,"props":137,"children":138},{},[139],{"type":41,"tag":96,"props":140,"children":142},{"className":141},[],[143],{"type":47,"value":144},"scripts\u002Fprobe_remote_models.sh",{"type":41,"tag":92,"props":146,"children":147},{},[148],{"type":47,"value":149},"Probe an OpenAI-compatible remote LLM\u002FVLM endpoint and verify the selected model id.",{"type":41,"tag":92,"props":151,"children":152},{},[153],{"type":47,"value":154},"Base URL, optional expected model id",{"type":41,"tag":50,"props":156,"children":158},{"id":157},"profile-routing",[159],{"type":47,"value":160},"Profile Routing",{"type":41,"tag":162,"props":163,"children":164},"p",{},[165],{"type":47,"value":166},"Match the user's request to a profile, then load that profile's reference for sizing, services, env recipes, and debugging.",{"type":41,"tag":57,"props":168,"children":169},{},[170,191],{"type":41,"tag":61,"props":171,"children":172},{},[173],{"type":41,"tag":65,"props":174,"children":175},{},[176,181,186],{"type":41,"tag":69,"props":177,"children":178},{},[179],{"type":47,"value":180},"User says",{"type":41,"tag":69,"props":182,"children":183},{},[184],{"type":47,"value":185},"Profile",{"type":41,"tag":69,"props":187,"children":188},{},[189],{"type":47,"value":190},"Reference",{"type":41,"tag":85,"props":192,"children":193},{},[194,224,253,282,311,340],{"type":41,"tag":65,"props":195,"children":196},{},[197,202,211],{"type":41,"tag":92,"props":198,"children":199},{},[200],{"type":47,"value":201},"\"deploy vss\" \u002F \"deploy base\"",{"type":41,"tag":92,"props":203,"children":204},{},[205],{"type":41,"tag":96,"props":206,"children":208},{"className":207},[],[209],{"type":47,"value":210},"base",{"type":41,"tag":92,"props":212,"children":213},{},[214],{"type":41,"tag":215,"props":216,"children":218},"a",{"href":217},"references\u002Fbase.md",[219],{"type":41,"tag":96,"props":220,"children":222},{"className":221},[],[223],{"type":47,"value":217},{"type":41,"tag":65,"props":225,"children":226},{},[227,232,241],{"type":41,"tag":92,"props":228,"children":229},{},[230],{"type":47,"value":231},"\"deploy alerts\" \u002F \"alert verification\" \u002F \"real-time alerts\" \u002F \"deploy for incident report\"",{"type":41,"tag":92,"props":233,"children":234},{},[235],{"type":41,"tag":96,"props":236,"children":238},{"className":237},[],[239],{"type":47,"value":240},"alerts",{"type":41,"tag":92,"props":242,"children":243},{},[244],{"type":41,"tag":215,"props":245,"children":247},{"href":246},"references\u002Falerts.md",[248],{"type":41,"tag":96,"props":249,"children":251},{"className":250},[],[252],{"type":47,"value":246},{"type":41,"tag":65,"props":254,"children":255},{},[256,261,270],{"type":41,"tag":92,"props":257,"children":258},{},[259],{"type":47,"value":260},"\"deploy lvs\" \u002F \"video summarization\"",{"type":41,"tag":92,"props":262,"children":263},{},[264],{"type":41,"tag":96,"props":265,"children":267},{"className":266},[],[268],{"type":47,"value":269},"lvs",{"type":41,"tag":92,"props":271,"children":272},{},[273],{"type":41,"tag":215,"props":274,"children":276},{"href":275},"references\u002Flvs-profile.md",[277],{"type":41,"tag":96,"props":278,"children":280},{"className":279},[],[281],{"type":47,"value":275},{"type":41,"tag":65,"props":283,"children":284},{},[285,290,299],{"type":41,"tag":92,"props":286,"children":287},{},[288],{"type":47,"value":289},"\"deploy search\" \u002F \"video search\"",{"type":41,"tag":92,"props":291,"children":292},{},[293],{"type":41,"tag":96,"props":294,"children":296},{"className":295},[],[297],{"type":47,"value":298},"search",{"type":41,"tag":92,"props":300,"children":301},{},[302],{"type":41,"tag":215,"props":303,"children":305},{"href":304},"references\u002Fsearch.md",[306],{"type":41,"tag":96,"props":307,"children":309},{"className":308},[],[310],{"type":47,"value":304},{"type":41,"tag":65,"props":312,"children":313},{},[314,319,328],{"type":41,"tag":92,"props":315,"children":316},{},[317],{"type":47,"value":318},"\"deploy warehouse\" \u002F \"warehouse blueprint\" \u002F \"vss warehouse\"",{"type":41,"tag":92,"props":320,"children":321},{},[322],{"type":41,"tag":96,"props":323,"children":325},{"className":324},[],[326],{"type":47,"value":327},"warehouse",{"type":41,"tag":92,"props":329,"children":330},{},[331],{"type":41,"tag":215,"props":332,"children":334},{"href":333},"references\u002Fwarehouse.md",[335],{"type":41,"tag":96,"props":336,"children":338},{"className":337},[],[339],{"type":47,"value":333},{"type":41,"tag":65,"props":341,"children":342},{},[343,348,358],{"type":41,"tag":92,"props":344,"children":345},{},[346],{"type":47,"value":347},"\"debug warehouse\" \u002F \"warehouse not working\" \u002F \"warehouse FPS low\" \u002F \"warehouse BEV out of sync\"",{"type":41,"tag":92,"props":349,"children":350},{},[351,356],{"type":41,"tag":96,"props":352,"children":354},{"className":353},[],[355],{"type":47,"value":327},{"type":47,"value":357}," (debug)",{"type":41,"tag":92,"props":359,"children":360},{},[361],{"type":41,"tag":215,"props":362,"children":364},{"href":363},"references\u002Fwarehouse-debug.md",[365],{"type":41,"tag":96,"props":366,"children":368},{"className":367},[],[369],{"type":47,"value":363},{"type":41,"tag":162,"props":371,"children":372},{},[373,379,381,390,392,398],{"type":41,"tag":374,"props":375,"children":376},"strong",{},[377],{"type":47,"value":378},"Edge hardware routing",{"type":47,"value":380}," (DGX Spark, AGX\u002FIGX Thor): see ",{"type":41,"tag":215,"props":382,"children":384},{"href":383},"references\u002Fedge.md",[385],{"type":41,"tag":96,"props":386,"children":388},{"className":387},[],[389],{"type":47,"value":383},{"type":47,"value":391},". DGX Spark uses the Spark Nano 9B standalone local LLM on port ",{"type":41,"tag":96,"props":393,"children":395},{"className":394},[],[396],{"type":47,"value":397},"30081",{"type":47,"value":399},"; AGX\u002FIGX Thor uses the Edge 4B standalone vLLM fallback.",{"type":41,"tag":162,"props":401,"children":402},{},[403,408],{"type":41,"tag":374,"props":404,"children":405},{},[406],{"type":47,"value":407},"Each profile's reference owns its sizing table.",{"type":47,"value":409}," Don't pick a deployment shape from this file — open the profile reference and check minimum GPU count for the host's hardware against the (mode × platform) matrix there.",{"type":41,"tag":50,"props":411,"children":413},{"id":412},"instructions",[414],{"type":47,"value":415},"Instructions",{"type":41,"tag":162,"props":417,"children":418},{},[419,421,427,429,435,437,442],{"type":47,"value":420},"The deployment flow is always: copy ",{"type":41,"tag":96,"props":422,"children":424},{"className":423},[],[425],{"type":47,"value":426},".env",{"type":47,"value":428}," to ",{"type":41,"tag":96,"props":430,"children":432},{"className":431},[],[433],{"type":47,"value":434},"generated.env",{"type":47,"value":436},", apply overrides, dry-run compose into ",{"type":41,"tag":96,"props":438,"children":440},{"className":439},[],[441],{"type":47,"value":120},{"type":47,"value":443},", review, normalize, deploy, then wait for readiness.",{"type":41,"tag":445,"props":446,"children":451},"pre",{"className":447,"code":448,"language":449,"meta":450,"style":450},"language-bash shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","# 1. cp dev-profile-\u003Cprofile>\u002F.env dev-profile-\u003Cprofile>\u002Fgenerated.env  (clean copy)\n# 2. Apply env overrides to generated.env  (source .env stays untouched)\n# 3. docker compose --env-file generated.env config > resolved.yml      (dry-run)\n# 4. Review resolved.yml\n# 5. docker compose --env-file generated.env -f resolved.yml up -d\n","bash","",[452],{"type":41,"tag":96,"props":453,"children":454},{"__ignoreMap":450},[455,467,476,485,494],{"type":41,"tag":456,"props":457,"children":460},"span",{"class":458,"line":459},"line",1,[461],{"type":41,"tag":456,"props":462,"children":464},{"style":463},"--shiki-light:#90A4AE;--shiki-light-font-style:italic;--shiki-default:#546E7A;--shiki-default-font-style:italic;--shiki-dark:#676E95;--shiki-dark-font-style:italic",[465],{"type":47,"value":466},"# 1. cp dev-profile-\u003Cprofile>\u002F.env dev-profile-\u003Cprofile>\u002Fgenerated.env  (clean copy)\n",{"type":41,"tag":456,"props":468,"children":470},{"class":458,"line":469},2,[471],{"type":41,"tag":456,"props":472,"children":473},{"style":463},[474],{"type":47,"value":475},"# 2. Apply env overrides to generated.env  (source .env stays untouched)\n",{"type":41,"tag":456,"props":477,"children":479},{"class":458,"line":478},3,[480],{"type":41,"tag":456,"props":481,"children":482},{"style":463},[483],{"type":47,"value":484},"# 3. docker compose --env-file generated.env config > resolved.yml      (dry-run)\n",{"type":41,"tag":456,"props":486,"children":488},{"class":458,"line":487},4,[489],{"type":41,"tag":456,"props":490,"children":491},{"style":463},[492],{"type":47,"value":493},"# 4. Review resolved.yml\n",{"type":41,"tag":456,"props":495,"children":497},{"class":458,"line":496},5,[498],{"type":41,"tag":456,"props":499,"children":500},{"style":463},[501],{"type":47,"value":502},"# 5. docker compose --env-file generated.env -f resolved.yml up -d\n",{"type":41,"tag":162,"props":504,"children":505},{},[506,511,513,518],{"type":41,"tag":96,"props":507,"children":509},{"className":508},[],[510],{"type":47,"value":426},{"type":47,"value":512}," is read-only checked-in defaults; ",{"type":41,"tag":96,"props":514,"children":516},{"className":515},[],[517],{"type":47,"value":434},{"type":47,"value":519}," is the per-deploy working copy. Step 1c covers this in full.",{"type":41,"tag":50,"props":521,"children":523},{"id":522},"prerequisites",[524],{"type":47,"value":525},"Prerequisites",{"type":41,"tag":527,"props":528,"children":529},"ol",{},[530,557,602],{"type":41,"tag":531,"props":532,"children":533},"li",{},[534,539,541,547,549,555],{"type":41,"tag":374,"props":535,"children":536},{},[537],{"type":47,"value":538},"Repo path",{"type":47,"value":540}," — auto-detect ",{"type":41,"tag":96,"props":542,"children":544},{"className":543},[],[545],{"type":47,"value":546},"video-search-and-summarization\u002F",{"type":47,"value":548}," before\nasking the user. Use the detected path as ",{"type":41,"tag":96,"props":550,"children":552},{"className":551},[],[553],{"type":47,"value":554},"$REPO",{"type":47,"value":556}," for all subsequent\ncommands.",{"type":41,"tag":531,"props":558,"children":559},{},[560,565,567,576,578,584,586,592,594,600],{"type":41,"tag":374,"props":561,"children":562},{},[563],{"type":47,"value":564},"Credential gates",{"type":47,"value":566}," — see ",{"type":41,"tag":215,"props":568,"children":570},{"href":569},"references\u002Fcredentials.md",[571],{"type":41,"tag":96,"props":572,"children":574},{"className":573},[],[575],{"type":47,"value":569},{"type":47,"value":577},": ",{"type":41,"tag":96,"props":579,"children":581},{"className":580},[],[582],{"type":47,"value":583},"NGC_CLI_API_KEY",{"type":47,"value":585}," for local\u002Flocal_shared NIM pulls, ",{"type":41,"tag":96,"props":587,"children":589},{"className":588},[],[590],{"type":47,"value":591},"NVIDIA_API_KEY",{"type":47,"value":593}," for remote NIM endpoints, and ",{"type":41,"tag":96,"props":595,"children":597},{"className":596},[],[598],{"type":47,"value":599},"HF_TOKEN",{"type":47,"value":601}," for edge recipes that use gated HF models.",{"type":41,"tag":531,"props":603,"children":604},{},[605,626,628,637,639,647],{"type":41,"tag":374,"props":606,"children":607},{},[608,610,616,618,624],{"type":47,"value":609},"System prerequisites (GPU driver, Docker, NVIDIA Container Toolkit, kernel sysctls, and — if ",{"type":41,"tag":96,"props":611,"children":613},{"className":612},[],[614],{"type":47,"value":615},"ufw",{"type":47,"value":617}," is active — the ",{"type":41,"tag":215,"props":619,"children":621},{"href":620},"references\u002Fprerequisites.md#firewall",[622],{"type":47,"value":623},"Docker-bridge→host firewall allow",{"type":47,"value":625}," so bridge NIMs can fetch clips from host-mode VST)",{"type":47,"value":627}," — full checks in ",{"type":41,"tag":215,"props":629,"children":631},{"href":630},"references\u002Fprerequisites.md",[632],{"type":41,"tag":96,"props":633,"children":635},{"className":634},[],[636],{"type":47,"value":630},{"type":47,"value":638},". Canonical hardware\u002Fdriver matrix is the ",{"type":41,"tag":215,"props":640,"children":644},{"href":641,"rel":642},"https:\u002F\u002Fdocs.nvidia.com\u002Fvss\u002F3.2.0\u002Fprerequisites.html",[643],"nofollow",[645],{"type":47,"value":646},"VSS prerequisites page",{"type":47,"value":648},".",{"type":41,"tag":162,"props":650,"children":651},{},[652,654,660,662,668,669,675,677,686,688,693],{"type":47,"value":653},"The auto-detect snippet (git-root, then a common-path probe gated on\n",{"type":41,"tag":96,"props":655,"children":657},{"className":656},[],[658],{"type":47,"value":659},"deploy\u002Fdocker\u002Fcompose.yml",{"type":47,"value":661}," + ",{"type":41,"tag":96,"props":663,"children":665},{"className":664},[],[666],{"type":47,"value":667},"dev-profile.sh",{"type":47,"value":661},{"type":41,"tag":96,"props":670,"children":672},{"className":671},[],[673],{"type":47,"value":674},"skills\u002Fvss-deploy-profile",{"type":47,"value":676},")\nlives in ",{"type":41,"tag":215,"props":678,"children":680},{"href":679},"references\u002Fprerequisites.md#repo-detect",[681],{"type":41,"tag":96,"props":682,"children":684},{"className":683},[],[685],{"type":47,"value":630},{"type":47,"value":687},".\nExport the resolved ",{"type":41,"tag":96,"props":689,"children":691},{"className":690},[],[692],{"type":47,"value":554},{"type":47,"value":694},"; if detection fails, ask the user for the checkout path.",{"type":41,"tag":696,"props":697,"children":699},"h3",{"id":698},"pre-flight-check",[700],{"type":47,"value":701},"Pre-flight check",{"type":41,"tag":162,"props":703,"children":704},{},[705,707,716,718,727],{"type":47,"value":706},"Run before every deploy. The full system checklist and remediation steps live\nin ",{"type":41,"tag":215,"props":708,"children":710},{"href":709},"references\u002Fprerequisites.md#preflight",[711],{"type":41,"tag":96,"props":712,"children":714},{"className":713},[],[715],{"type":47,"value":630},{"type":47,"value":717},".\nFor DGX Spark \u002F IGX Thor \u002F AGX Thor, also run the cache-cleaner check in\n",{"type":41,"tag":215,"props":719,"children":721},{"href":720},"references\u002Fedge.md#cache-cleaner-every-edge-deploy",[722],{"type":41,"tag":96,"props":723,"children":725},{"className":724},[],[726],{"type":47,"value":383},{"type":47,"value":648},{"type":41,"tag":162,"props":729,"children":730},{},[731,736,738,744,746,752],{"type":41,"tag":374,"props":732,"children":733},{},[734],{"type":47,"value":735},"Detect sudo mode first.",{"type":47,"value":737}," Several pre-flight remediations and the\nedge cache-cleaner installer call ",{"type":41,"tag":96,"props":739,"children":741},{"className":740},[],[742],{"type":47,"value":743},"sudo",{"type":47,"value":745},". If the host requires a\nsudo password, those steps will silently no-op under ",{"type":41,"tag":96,"props":747,"children":749},{"className":748},[],[750],{"type":47,"value":751},"sudo -n",{"type":47,"value":753}," and\nleave the deploy in a half-prepared state.",{"type":41,"tag":445,"props":755,"children":757},{"className":447,"code":756,"language":449,"meta":450,"style":450},"if sudo -n true 2>\u002Fdev\u002Fnull; then\n  echo \"passwordless sudo — pre-flight will auto-install missing pieces\"\nelse\n  echo \"sudo requires password — pre-flight will NOT auto-install; hand commands to the user\"\nfi\n",[758],{"type":41,"tag":96,"props":759,"children":760},{"__ignoreMap":450},[761,808,832,840,860],{"type":41,"tag":456,"props":762,"children":763},{"class":458,"line":459},[764,770,776,782,788,793,798,803],{"type":41,"tag":456,"props":765,"children":767},{"style":766},"--shiki-light:#39ADB5;--shiki-light-font-style:italic;--shiki-default:#89DDFF;--shiki-default-font-style:italic;--shiki-dark:#89DDFF;--shiki-dark-font-style:italic",[768],{"type":47,"value":769},"if",{"type":41,"tag":456,"props":771,"children":773},{"style":772},"--shiki-light:#E2931D;--shiki-default:#FFCB6B;--shiki-dark:#FFCB6B",[774],{"type":47,"value":775}," sudo",{"type":41,"tag":456,"props":777,"children":779},{"style":778},"--shiki-light:#91B859;--shiki-default:#C3E88D;--shiki-dark:#C3E88D",[780],{"type":47,"value":781}," -n",{"type":41,"tag":456,"props":783,"children":785},{"style":784},"--shiki-light:#39ADB5;--shiki-default:#89DDFF;--shiki-dark:#89DDFF",[786],{"type":47,"value":787}," true",{"type":41,"tag":456,"props":789,"children":790},{"style":784},[791],{"type":47,"value":792}," 2>",{"type":41,"tag":456,"props":794,"children":795},{"style":778},[796],{"type":47,"value":797},"\u002Fdev\u002Fnull",{"type":41,"tag":456,"props":799,"children":800},{"style":784},[801],{"type":47,"value":802},";",{"type":41,"tag":456,"props":804,"children":805},{"style":766},[806],{"type":47,"value":807}," then\n",{"type":41,"tag":456,"props":809,"children":810},{"class":458,"line":469},[811,817,822,827],{"type":41,"tag":456,"props":812,"children":814},{"style":813},"--shiki-light:#6182B8;--shiki-default:#82AAFF;--shiki-dark:#82AAFF",[815],{"type":47,"value":816},"  echo",{"type":41,"tag":456,"props":818,"children":819},{"style":784},[820],{"type":47,"value":821}," \"",{"type":41,"tag":456,"props":823,"children":824},{"style":778},[825],{"type":47,"value":826},"passwordless sudo — pre-flight will auto-install missing pieces",{"type":41,"tag":456,"props":828,"children":829},{"style":784},[830],{"type":47,"value":831},"\"\n",{"type":41,"tag":456,"props":833,"children":834},{"class":458,"line":478},[835],{"type":41,"tag":456,"props":836,"children":837},{"style":766},[838],{"type":47,"value":839},"else\n",{"type":41,"tag":456,"props":841,"children":842},{"class":458,"line":487},[843,847,851,856],{"type":41,"tag":456,"props":844,"children":845},{"style":813},[846],{"type":47,"value":816},{"type":41,"tag":456,"props":848,"children":849},{"style":784},[850],{"type":47,"value":821},{"type":41,"tag":456,"props":852,"children":853},{"style":778},[854],{"type":47,"value":855},"sudo requires password — pre-flight will NOT auto-install; hand commands to the user",{"type":41,"tag":456,"props":857,"children":858},{"style":784},[859],{"type":47,"value":831},{"type":41,"tag":456,"props":861,"children":862},{"class":458,"line":496},[863],{"type":41,"tag":456,"props":864,"children":865},{"style":766},[866],{"type":47,"value":867},"fi\n",{"type":41,"tag":162,"props":869,"children":870},{},[871,873,878,880,885,887,893],{"type":47,"value":872},"When sudo needs a password, the skill ",{"type":41,"tag":374,"props":874,"children":875},{},[876],{"type":47,"value":877},"must not",{"type":47,"value":879}," run privileged\ninstallers itself. Surface the copy-pasteable command block from\n",{"type":41,"tag":96,"props":881,"children":883},{"className":882},[],[884],{"type":47,"value":630},{"type":47,"value":886}," to the user with a ",{"type":41,"tag":888,"props":889,"children":890},"em",{},[891],{"type":47,"value":892},"\"run this once and\nconfirm\"",{"type":47,"value":894}," handoff, then resume after the user replies.",{"type":41,"tag":162,"props":896,"children":897},{},[898],{"type":47,"value":899},"Minimum smoke test (must succeed):",{"type":41,"tag":445,"props":901,"children":903},{"className":447,"code":902,"language":449,"meta":450,"style":450},"nvidia-smi --query-gpu=index,name --format=csv,noheader\ndocker info 2>\u002Fdev\u002Fnull | grep -qi runtimes \\\n  && docker run --rm --gpus all ubuntu:22.04 nvidia-smi >\u002Fdev\u002Fnull 2>&1 \\\n  && echo \"nvidia runtime OK\"\n",[904],{"type":41,"tag":96,"props":905,"children":906},{"__ignoreMap":450},[907,925,972,1033],{"type":41,"tag":456,"props":908,"children":909},{"class":458,"line":459},[910,915,920],{"type":41,"tag":456,"props":911,"children":912},{"style":772},[913],{"type":47,"value":914},"nvidia-smi",{"type":41,"tag":456,"props":916,"children":917},{"style":778},[918],{"type":47,"value":919}," --query-gpu=index,name",{"type":41,"tag":456,"props":921,"children":922},{"style":778},[923],{"type":47,"value":924}," --format=csv,noheader\n",{"type":41,"tag":456,"props":926,"children":927},{"class":458,"line":469},[928,933,938,942,946,951,956,961,966],{"type":41,"tag":456,"props":929,"children":930},{"style":772},[931],{"type":47,"value":932},"docker",{"type":41,"tag":456,"props":934,"children":935},{"style":778},[936],{"type":47,"value":937}," info",{"type":41,"tag":456,"props":939,"children":940},{"style":784},[941],{"type":47,"value":792},{"type":41,"tag":456,"props":943,"children":944},{"style":778},[945],{"type":47,"value":797},{"type":41,"tag":456,"props":947,"children":948},{"style":784},[949],{"type":47,"value":950}," |",{"type":41,"tag":456,"props":952,"children":953},{"style":772},[954],{"type":47,"value":955}," grep",{"type":41,"tag":456,"props":957,"children":958},{"style":778},[959],{"type":47,"value":960}," -qi",{"type":41,"tag":456,"props":962,"children":963},{"style":778},[964],{"type":47,"value":965}," runtimes",{"type":41,"tag":456,"props":967,"children":969},{"style":968},"--shiki-light:#90A4AE;--shiki-default:#EEFFFF;--shiki-dark:#BABED8",[970],{"type":47,"value":971}," \\\n",{"type":41,"tag":456,"props":973,"children":974},{"class":458,"line":478},[975,980,985,990,995,1000,1005,1010,1015,1020,1024,1029],{"type":41,"tag":456,"props":976,"children":977},{"style":784},[978],{"type":47,"value":979},"  &&",{"type":41,"tag":456,"props":981,"children":982},{"style":772},[983],{"type":47,"value":984}," docker",{"type":41,"tag":456,"props":986,"children":987},{"style":778},[988],{"type":47,"value":989}," run",{"type":41,"tag":456,"props":991,"children":992},{"style":778},[993],{"type":47,"value":994}," --rm",{"type":41,"tag":456,"props":996,"children":997},{"style":778},[998],{"type":47,"value":999}," --gpus",{"type":41,"tag":456,"props":1001,"children":1002},{"style":778},[1003],{"type":47,"value":1004}," all",{"type":41,"tag":456,"props":1006,"children":1007},{"style":778},[1008],{"type":47,"value":1009}," ubuntu:22.04",{"type":41,"tag":456,"props":1011,"children":1012},{"style":778},[1013],{"type":47,"value":1014}," nvidia-smi",{"type":41,"tag":456,"props":1016,"children":1017},{"style":784},[1018],{"type":47,"value":1019}," >",{"type":41,"tag":456,"props":1021,"children":1022},{"style":778},[1023],{"type":47,"value":797},{"type":41,"tag":456,"props":1025,"children":1026},{"style":784},[1027],{"type":47,"value":1028}," 2>&1",{"type":41,"tag":456,"props":1030,"children":1031},{"style":968},[1032],{"type":47,"value":971},{"type":41,"tag":456,"props":1034,"children":1035},{"class":458,"line":487},[1036,1040,1045,1049,1054],{"type":41,"tag":456,"props":1037,"children":1038},{"style":784},[1039],{"type":47,"value":979},{"type":41,"tag":456,"props":1041,"children":1042},{"style":813},[1043],{"type":47,"value":1044}," echo",{"type":41,"tag":456,"props":1046,"children":1047},{"style":784},[1048],{"type":47,"value":821},{"type":41,"tag":456,"props":1050,"children":1051},{"style":778},[1052],{"type":47,"value":1053},"nvidia runtime OK",{"type":41,"tag":456,"props":1055,"children":1056},{"style":784},[1057],{"type":47,"value":831},{"type":41,"tag":162,"props":1059,"children":1060},{},[1061,1063,1071],{"type":47,"value":1062},"If the smoke test fails, do not proceed; open\n",{"type":41,"tag":215,"props":1064,"children":1065},{"href":709},[1066],{"type":41,"tag":96,"props":1067,"children":1069},{"className":1068},[],[1070],{"type":47,"value":630},{"type":47,"value":1072},"\nfor the remediation tree.",{"type":41,"tag":50,"props":1074,"children":1076},{"id":1075},"model-selection",[1077],{"type":47,"value":1078},"Model Selection",{"type":41,"tag":1080,"props":1081,"children":1082},"ul",{},[1083,1102],{"type":41,"tag":531,"props":1084,"children":1085},{},[1086,1092,1094,1100],{"type":41,"tag":96,"props":1087,"children":1089},{"className":1088},[],[1090],{"type":47,"value":1091},"$LLM_REMOTE_URL",{"type":47,"value":1093}," \u002F ",{"type":41,"tag":96,"props":1095,"children":1097},{"className":1096},[],[1098],{"type":47,"value":1099},"$VLM_REMOTE_URL",{"type":47,"value":1101}," if the user asks for remote",{"type":41,"tag":531,"props":1103,"children":1104},{},[1105,1111,1113,1119],{"type":41,"tag":96,"props":1106,"children":1108},{"className":1107},[],[1109],{"type":47,"value":1110},"$NGC_CLI_API_KEY",{"type":47,"value":1112}," (local NIMs) or ",{"type":41,"tag":96,"props":1114,"children":1116},{"className":1115},[],[1117],{"type":47,"value":1118},"$NVIDIA_API_KEY",{"type":47,"value":1120}," (remote)",{"type":41,"tag":162,"props":1122,"children":1123},{},[1124,1129,1131,1137,1139,1145,1146,1152,1153,1159,1161,1167,1169,1175],{"type":41,"tag":374,"props":1125,"children":1126},{},[1127],{"type":47,"value":1128},"Endpoint intent gate.",{"type":47,"value":1130}," Don't infer remote placement from stray env vars\n(",{"type":41,"tag":96,"props":1132,"children":1134},{"className":1133},[],[1135],{"type":47,"value":1136},"LLM_ENDPOINT_URL",{"type":47,"value":1138},", ",{"type":41,"tag":96,"props":1140,"children":1142},{"className":1141},[],[1143],{"type":47,"value":1144},"VLM_ENDPOINT_URL",{"type":47,"value":1138},{"type":41,"tag":96,"props":1147,"children":1149},{"className":1148},[],[1150],{"type":47,"value":1151},"LLM_BASE_URL",{"type":47,"value":1138},{"type":41,"tag":96,"props":1154,"children":1156},{"className":1155},[],[1157],{"type":47,"value":1158},"VLM_BASE_URL",{"type":47,"value":1160}," may be\nleftovers). Use remote LLM\u002FVLM only when (1) the user asked for \u002F supplied a\nremote endpoint, (2) local sizing can't fit the selected models and the user\nagrees, or (3) an edge recipe needs a standalone local service VSS treats as\n",{"type":41,"tag":96,"props":1162,"children":1164},{"className":1163},[],[1165],{"type":47,"value":1166},"remote",{"type":47,"value":1168}," (e.g. DGX Spark Nano 9B on ",{"type":41,"tag":96,"props":1170,"children":1172},{"className":1171},[],[1173],{"type":47,"value":1174},"localhost:30081",{"type":47,"value":1176},"). If an endpoint var is\nset but the user didn't ask for remote, surface it in Step 1 and ask — never\nsilently deploy remote because a var happened to exist.",{"type":41,"tag":162,"props":1178,"children":1179},{},[1180,1182,1187],{"type":47,"value":1181},"If no combination on this host satisfies the profile's sizing requirements, ",{"type":41,"tag":374,"props":1183,"children":1184},{},[1185],{"type":47,"value":1186},"stop and report the blocker",{"type":47,"value":1188}," — don't silently pick another shape.",{"type":41,"tag":1190,"props":1191,"children":1192},"blockquote",{},[1193],{"type":41,"tag":162,"props":1194,"children":1195},{},[1196,1201,1203,1211],{"type":41,"tag":374,"props":1197,"children":1198},{},[1199],{"type":47,"value":1200},"Edge shared mode is platform-specific.",{"type":47,"value":1202}," Full recipes are in ",{"type":41,"tag":215,"props":1204,"children":1205},{"href":383},[1206],{"type":41,"tag":96,"props":1207,"children":1209},{"className":1208},[],[1210],{"type":47,"value":383},{"type":47,"value":648},{"type":41,"tag":50,"props":1213,"children":1215},{"id":1214},"deployment-flow",[1216],{"type":47,"value":1217},"Deployment Flow",{"type":41,"tag":162,"props":1219,"children":1220},{},[1221],{"type":47,"value":1222},"Always follow this sequence. Never skip the dry-run.",{"type":41,"tag":696,"props":1224,"children":1226},{"id":1225},"step-0-tear-down-any-existing-deployment-clear-data-volumes",[1227],{"type":47,"value":1228},"Step 0 — Tear down any existing deployment + clear data volumes",{"type":41,"tag":162,"props":1230,"children":1231},{},[1232],{"type":47,"value":1233},"If a deployment already exists, tear it down AND clear stale data volumes before redeploying.",{"type":41,"tag":162,"props":1235,"children":1236},{},[1237,1239,1248],{"type":47,"value":1238},"Full procedure lives in ",{"type":41,"tag":215,"props":1240,"children":1242},{"href":1241},"references\u002Fteardown.md",[1243],{"type":41,"tag":96,"props":1244,"children":1246},{"className":1245},[],[1247],{"type":47,"value":1241},{"type":47,"value":648},{"type":41,"tag":696,"props":1250,"children":1252},{"id":1251},"step-0a-credentials-gate-run-before-any-env-mutation",[1253],{"type":47,"value":1254},"Step 0a — Credentials gate (run before any env mutation)",{"type":41,"tag":162,"props":1256,"children":1257},{},[1258,1260,1265,1267,1272,1273,1278,1280,1288,1290,1295,1297,1302],{"type":47,"value":1259},"Validate every credential and selected remote endpoint the chosen profile\nneeds ",{"type":41,"tag":374,"props":1261,"children":1262},{},[1263],{"type":47,"value":1264},"before",{"type":47,"value":1266}," Step 1c copies ",{"type":41,"tag":96,"props":1268,"children":1270},{"className":1269},[],[1271],{"type":47,"value":426},{"type":47,"value":428},{"type":41,"tag":96,"props":1274,"children":1276},{"className":1275},[],[1277],{"type":47,"value":434},{"type":47,"value":1279},". A 401 here is a\n30-second failure; the same 401 inside a NIM cold-start is a 10–20 min\nfailure. Run the discovery and probe flow in\n",{"type":41,"tag":215,"props":1281,"children":1282},{"href":569},[1283],{"type":41,"tag":96,"props":1284,"children":1286},{"className":1285},[],[1287],{"type":47,"value":569},{"type":47,"value":1289},", including\n",{"type":41,"tag":96,"props":1291,"children":1293},{"className":1292},[],[1294],{"type":47,"value":144},{"type":47,"value":1296}," for any LLM\u002FVLM endpoint you plan to write\ninto ",{"type":41,"tag":96,"props":1298,"children":1300},{"className":1299},[],[1301],{"type":47,"value":434},{"type":47,"value":1303},". Map the result against the chosen mode: missing\nor invalid required credentials\u002Fendpoints are blockers, optional credentials\nare not.",{"type":41,"tag":696,"props":1305,"children":1307},{"id":1306},"step-1-gather-context",[1308],{"type":47,"value":1309},"Step 1 — Gather context",{"type":41,"tag":162,"props":1311,"children":1312},{},[1313],{"type":47,"value":1314},"Before building env overrides, confirm:",{"type":41,"tag":57,"props":1316,"children":1317},{},[1318,1334],{"type":41,"tag":61,"props":1319,"children":1320},{},[1321],{"type":41,"tag":65,"props":1322,"children":1323},{},[1324,1329],{"type":41,"tag":69,"props":1325,"children":1326},{},[1327],{"type":47,"value":1328},"Value",{"type":41,"tag":69,"props":1330,"children":1331},{},[1332],{"type":47,"value":1333},"How to determine",{"type":41,"tag":85,"props":1335,"children":1336},{},[1337,1357,1379,1399,1422,1450,1499,1539],{"type":41,"tag":65,"props":1338,"children":1339},{},[1340,1347],{"type":41,"tag":92,"props":1341,"children":1342},{},[1343],{"type":41,"tag":374,"props":1344,"children":1345},{},[1346],{"type":47,"value":185},{"type":41,"tag":92,"props":1348,"children":1349},{},[1350,1352],{"type":47,"value":1351},"Match user intent to the routing table above. Default: ",{"type":41,"tag":96,"props":1353,"children":1355},{"className":1354},[],[1356],{"type":47,"value":210},{"type":41,"tag":65,"props":1358,"children":1359},{},[1360,1367],{"type":41,"tag":92,"props":1361,"children":1362},{},[1363],{"type":41,"tag":374,"props":1364,"children":1365},{},[1366],{"type":47,"value":538},{"type":41,"tag":92,"props":1368,"children":1369},{},[1370,1372,1377],{"type":47,"value":1371},"Use the ",{"type":41,"tag":96,"props":1373,"children":1375},{"className":1374},[],[1376],{"type":47,"value":554},{"type":47,"value":1378}," value auto-detected in prerequisites. If auto-detect failed, ask the user for the checkout path before continuing.",{"type":41,"tag":65,"props":1380,"children":1381},{},[1382,1390],{"type":41,"tag":92,"props":1383,"children":1384},{},[1385],{"type":41,"tag":374,"props":1386,"children":1387},{},[1388],{"type":47,"value":1389},"Hardware",{"type":41,"tag":92,"props":1391,"children":1392},{},[1393],{"type":41,"tag":96,"props":1394,"children":1396},{"className":1395},[],[1397],{"type":47,"value":1398},"nvidia-smi --query-gpu=name,memory.total --format=csv,noheader",{"type":41,"tag":65,"props":1400,"children":1401},{},[1402,1410],{"type":41,"tag":92,"props":1403,"children":1404},{},[1405],{"type":41,"tag":374,"props":1406,"children":1407},{},[1408],{"type":47,"value":1409},"LLM\u002FVLM placement",{"type":41,"tag":92,"props":1411,"children":1412},{},[1413,1415,1420],{"type":47,"value":1414},"Explicitly decide local \u002F local_shared \u002F remote. Cross-reference available GPUs against the chosen profile's ",{"type":41,"tag":374,"props":1416,"children":1417},{},[1418],{"type":47,"value":1419},"Minimum GPU count",{"type":47,"value":1421}," table. If endpoint env vars are present but the user did not request remote, ask whether to use or ignore them.",{"type":41,"tag":65,"props":1423,"children":1424},{},[1425,1433],{"type":41,"tag":92,"props":1426,"children":1427},{},[1428],{"type":41,"tag":374,"props":1429,"children":1430},{},[1431],{"type":47,"value":1432},"API keys",{"type":41,"tag":92,"props":1434,"children":1435},{},[1436,1441,1443,1448],{"type":41,"tag":96,"props":1437,"children":1439},{"className":1438},[],[1440],{"type":47,"value":583},{"type":47,"value":1442}," for local NIMs, ",{"type":41,"tag":96,"props":1444,"children":1446},{"className":1445},[],[1447],{"type":47,"value":591},{"type":47,"value":1449}," for remote",{"type":41,"tag":65,"props":1451,"children":1452},{},[1453,1465],{"type":41,"tag":92,"props":1454,"children":1455},{},[1456],{"type":41,"tag":374,"props":1457,"children":1458},{},[1459],{"type":41,"tag":96,"props":1460,"children":1462},{"className":1461},[],[1463],{"type":47,"value":1464},"HOST_IP",{"type":41,"tag":92,"props":1466,"children":1467},{},[1468,1470,1476,1478,1483,1485,1490,1492,1498],{"type":47,"value":1469},"In-cluster dial address: ",{"type":41,"tag":96,"props":1471,"children":1473},{"className":1472},[],[1474],{"type":47,"value":1475},"ip route get 1.1.1.1",{"type":47,"value":1477}," src (like ",{"type":41,"tag":96,"props":1479,"children":1481},{"className":1480},[],[1482],{"type":47,"value":667},{"type":47,"value":1484},"; correct on LAN + cloud). If that interface is a VPN\u002Ftunnel, fall back to the LAN IP and ",{"type":41,"tag":374,"props":1486,"children":1487},{},[1488],{"type":47,"value":1489},"prompt the user",{"type":47,"value":1491}," — ",{"type":41,"tag":215,"props":1493,"children":1495},{"href":1494},"references\u002Fprerequisites.md#addressing",[1496],{"type":47,"value":1497},"Network addressing",{"type":47,"value":648},{"type":41,"tag":65,"props":1500,"children":1501},{},[1502,1514],{"type":41,"tag":92,"props":1503,"children":1504},{},[1505],{"type":41,"tag":374,"props":1506,"children":1507},{},[1508],{"type":41,"tag":96,"props":1509,"children":1511},{"className":1510},[],[1512],{"type":47,"value":1513},"EXTERNAL_IP",{"type":41,"tag":92,"props":1515,"children":1516},{},[1517,1519,1525,1527,1532,1534,1538],{"type":47,"value":1518},"Browser-facing address; defaults to ",{"type":41,"tag":96,"props":1520,"children":1522},{"className":1521},[],[1523],{"type":47,"value":1524},"${HOST_IP}",{"type":47,"value":1526},". Override when the browser path differs — cloud public IP, Brev secure-link (Step 1d), or tunnel; ",{"type":41,"tag":374,"props":1528,"children":1529},{},[1530],{"type":47,"value":1531},"ask the user where they browse from if unsure",{"type":47,"value":1533},". ",{"type":41,"tag":215,"props":1535,"children":1536},{"href":1494},[1537],{"type":47,"value":1497},{"type":47,"value":648},{"type":41,"tag":65,"props":1540,"children":1541},{},[1542,1554],{"type":41,"tag":92,"props":1543,"children":1544},{},[1545],{"type":41,"tag":374,"props":1546,"children":1547},{},[1548],{"type":41,"tag":96,"props":1549,"children":1551},{"className":1550},[],[1552],{"type":47,"value":1553},"HAPROXY_PORT",{"type":41,"tag":92,"props":1555,"children":1556},{},[1557,1559,1565],{"type":47,"value":1558},"Browser-facing ingress port. Default ",{"type":41,"tag":96,"props":1560,"children":1562},{"className":1561},[],[1563],{"type":47,"value":1564},"7777",{"type":47,"value":1566},"; ensure it is free.",{"type":41,"tag":162,"props":1568,"children":1569},{},[1570,1572,1578,1580,1585,1586,1591,1592,1598,1600,1606],{"type":47,"value":1571},"Before ",{"type":41,"tag":96,"props":1573,"children":1575},{"className":1574},[],[1576],{"type":47,"value":1577},"docker compose up",{"type":47,"value":1579},", verify ",{"type":41,"tag":96,"props":1581,"children":1583},{"className":1582},[],[1584],{"type":47,"value":1513},{"type":47,"value":1138},{"type":41,"tag":96,"props":1587,"children":1589},{"className":1588},[],[1590],{"type":47,"value":1553},{"type":47,"value":1138},{"type":41,"tag":96,"props":1593,"children":1595},{"className":1594},[],[1596],{"type":47,"value":1597},"VSS_PUBLIC_HOST",{"type":47,"value":1599},", and ",{"type":41,"tag":96,"props":1601,"children":1603},{"className":1602},[],[1604],{"type":47,"value":1605},"VSS_PUBLIC_PORT",{"type":47,"value":1607}," are populated with browser-reachable values. Otherwise the stack may appear healthy while UI\u002FAPI\u002FVST links 404 or loop through Cloudflare Access.",{"type":41,"tag":696,"props":1609,"children":1611},{"id":1610},"step-1b-prepare-the-data-directory",[1612],{"type":47,"value":1613},"Step 1b — Prepare the data directory",{"type":41,"tag":162,"props":1615,"children":1616},{},[1617,1619,1628],{"type":47,"value":1618},"Layout (asset paths, ownership, mount points, profile-specific subdirs) is documented in ",{"type":41,"tag":215,"props":1620,"children":1622},{"href":1621},"references\u002Fdata-directory.md",[1623],{"type":41,"tag":96,"props":1624,"children":1626},{"className":1625},[],[1627],{"type":47,"value":1621},{"type":47,"value":1629},". Read that file before deploying for the first time on a host or when changing profiles.",{"type":41,"tag":696,"props":1631,"children":1633},{"id":1632},"step-1c-initialize-generatedenv",[1634,1636],{"type":47,"value":1635},"Step 1c — Initialize ",{"type":41,"tag":96,"props":1637,"children":1639},{"className":1638},[],[1640],{"type":47,"value":434},{"type":41,"tag":162,"props":1642,"children":1643},{},[1644,1646,1651],{"type":47,"value":1645},"The skill's per-deploy working copy. Always start from a fresh copy of the source ",{"type":41,"tag":96,"props":1647,"children":1649},{"className":1648},[],[1650],{"type":47,"value":426},{"type":47,"value":1652}," , never mutate the source.",{"type":41,"tag":445,"props":1654,"children":1656},{"className":447,"code":1655,"language":449,"meta":450,"style":450},"PROFILE=base\nENV_SRC=$REPO\u002Fdeploy\u002Fdocker\u002Fdeveloper-profiles\u002Fdev-profile-$PROFILE\u002F.env\nENV_GEN=$REPO\u002Fdeploy\u002Fdocker\u002Fdeveloper-profiles\u002Fdev-profile-$PROFILE\u002Fgenerated.env\n\ncp \"$ENV_SRC\" \"$ENV_GEN\"\n",[1657],{"type":41,"tag":96,"props":1658,"children":1659},{"__ignoreMap":450},[1660,1678,1709,1738,1747],{"type":41,"tag":456,"props":1661,"children":1662},{"class":458,"line":459},[1663,1668,1673],{"type":41,"tag":456,"props":1664,"children":1665},{"style":968},[1666],{"type":47,"value":1667},"PROFILE",{"type":41,"tag":456,"props":1669,"children":1670},{"style":784},[1671],{"type":47,"value":1672},"=",{"type":41,"tag":456,"props":1674,"children":1675},{"style":778},[1676],{"type":47,"value":1677},"base\n",{"type":41,"tag":456,"props":1679,"children":1680},{"class":458,"line":469},[1681,1686,1690,1694,1699,1704],{"type":41,"tag":456,"props":1682,"children":1683},{"style":968},[1684],{"type":47,"value":1685},"ENV_SRC",{"type":41,"tag":456,"props":1687,"children":1688},{"style":784},[1689],{"type":47,"value":1672},{"type":41,"tag":456,"props":1691,"children":1692},{"style":968},[1693],{"type":47,"value":554},{"type":41,"tag":456,"props":1695,"children":1696},{"style":778},[1697],{"type":47,"value":1698},"\u002Fdeploy\u002Fdocker\u002Fdeveloper-profiles\u002Fdev-profile-",{"type":41,"tag":456,"props":1700,"children":1701},{"style":968},[1702],{"type":47,"value":1703},"$PROFILE",{"type":41,"tag":456,"props":1705,"children":1706},{"style":778},[1707],{"type":47,"value":1708},"\u002F.env\n",{"type":41,"tag":456,"props":1710,"children":1711},{"class":458,"line":478},[1712,1717,1721,1725,1729,1733],{"type":41,"tag":456,"props":1713,"children":1714},{"style":968},[1715],{"type":47,"value":1716},"ENV_GEN",{"type":41,"tag":456,"props":1718,"children":1719},{"style":784},[1720],{"type":47,"value":1672},{"type":41,"tag":456,"props":1722,"children":1723},{"style":968},[1724],{"type":47,"value":554},{"type":41,"tag":456,"props":1726,"children":1727},{"style":778},[1728],{"type":47,"value":1698},{"type":41,"tag":456,"props":1730,"children":1731},{"style":968},[1732],{"type":47,"value":1703},{"type":41,"tag":456,"props":1734,"children":1735},{"style":778},[1736],{"type":47,"value":1737},"\u002Fgenerated.env\n",{"type":41,"tag":456,"props":1739,"children":1740},{"class":458,"line":487},[1741],{"type":41,"tag":456,"props":1742,"children":1744},{"emptyLinePlaceholder":1743},true,[1745],{"type":47,"value":1746},"\n",{"type":41,"tag":456,"props":1748,"children":1749},{"class":458,"line":496},[1750,1755,1759,1764,1769,1773,1778],{"type":41,"tag":456,"props":1751,"children":1752},{"style":772},[1753],{"type":47,"value":1754},"cp",{"type":41,"tag":456,"props":1756,"children":1757},{"style":784},[1758],{"type":47,"value":821},{"type":41,"tag":456,"props":1760,"children":1761},{"style":968},[1762],{"type":47,"value":1763},"$ENV_SRC",{"type":41,"tag":456,"props":1765,"children":1766},{"style":784},[1767],{"type":47,"value":1768},"\"",{"type":41,"tag":456,"props":1770,"children":1771},{"style":784},[1772],{"type":47,"value":821},{"type":41,"tag":456,"props":1774,"children":1775},{"style":968},[1776],{"type":47,"value":1777},"$ENV_GEN",{"type":41,"tag":456,"props":1779,"children":1780},{"style":784},[1781],{"type":47,"value":831},{"type":41,"tag":162,"props":1783,"children":1784},{},[1785,1787,1792,1794,1799,1800,1805],{"type":47,"value":1786},"All subsequent writes (Brev ",{"type":41,"tag":96,"props":1788,"children":1790},{"className":1789},[],[1791],{"type":47,"value":1513},{"type":47,"value":1793},", the env_overrides dict from Step 2) go to ",{"type":41,"tag":96,"props":1795,"children":1797},{"className":1796},[],[1798],{"type":47,"value":1777},{"type":47,"value":1533},{"type":41,"tag":96,"props":1801,"children":1803},{"className":1802},[],[1804],{"type":47,"value":1763},{"type":47,"value":1806}," is read-only from here on.",{"type":41,"tag":696,"props":1808,"children":1810},{"id":1809},"step-1d-brev-only-detect-first-then-set-external_ip-to-the-secure-link-domain",[1811,1813,1818],{"type":47,"value":1812},"Step 1d — Brev only: detect first, then set ",{"type":41,"tag":96,"props":1814,"children":1816},{"className":1815},[],[1817],{"type":47,"value":1513},{"type":47,"value":1819}," to the secure-link domain",{"type":41,"tag":162,"props":1821,"children":1822},{},[1823,1828,1830,1836,1838,1844],{"type":41,"tag":374,"props":1824,"children":1825},{},[1826],{"type":47,"value":1827},"Detect Brev before anything else",{"type":47,"value":1829}," — a Brev-provisioned instance sets ",{"type":41,"tag":96,"props":1831,"children":1833},{"className":1832},[],[1834],{"type":47,"value":1835},"BREV_ENV_ID",{"type":47,"value":1837}," in ",{"type":41,"tag":96,"props":1839,"children":1841},{"className":1840},[],[1842],{"type":47,"value":1843},"\u002Fetc\u002Fenvironment",{"type":47,"value":1845},"; nothing else does:",{"type":41,"tag":445,"props":1847,"children":1849},{"className":447,"code":1848,"language":449,"meta":450,"style":450},"grep -qE '^BREV_ENV_ID=' \u002Fetc\u002Fenvironment && echo \"on Brev\" || echo \"not Brev\"\n",[1850],{"type":41,"tag":96,"props":1851,"children":1852},{"__ignoreMap":450},[1853],{"type":41,"tag":456,"props":1854,"children":1855},{"class":458,"line":459},[1856,1861,1866,1871,1876,1881,1886,1891,1895,1899,1904,1908,1913,1917,1921,1926],{"type":41,"tag":456,"props":1857,"children":1858},{"style":772},[1859],{"type":47,"value":1860},"grep",{"type":41,"tag":456,"props":1862,"children":1863},{"style":778},[1864],{"type":47,"value":1865}," -qE",{"type":41,"tag":456,"props":1867,"children":1868},{"style":784},[1869],{"type":47,"value":1870}," '",{"type":41,"tag":456,"props":1872,"children":1873},{"style":778},[1874],{"type":47,"value":1875},"^BREV_ENV_ID=",{"type":41,"tag":456,"props":1877,"children":1878},{"style":784},[1879],{"type":47,"value":1880},"'",{"type":41,"tag":456,"props":1882,"children":1883},{"style":778},[1884],{"type":47,"value":1885}," \u002Fetc\u002Fenvironment",{"type":41,"tag":456,"props":1887,"children":1888},{"style":784},[1889],{"type":47,"value":1890}," &&",{"type":41,"tag":456,"props":1892,"children":1893},{"style":813},[1894],{"type":47,"value":1044},{"type":41,"tag":456,"props":1896,"children":1897},{"style":784},[1898],{"type":47,"value":821},{"type":41,"tag":456,"props":1900,"children":1901},{"style":778},[1902],{"type":47,"value":1903},"on Brev",{"type":41,"tag":456,"props":1905,"children":1906},{"style":784},[1907],{"type":47,"value":1768},{"type":41,"tag":456,"props":1909,"children":1910},{"style":784},[1911],{"type":47,"value":1912}," ||",{"type":41,"tag":456,"props":1914,"children":1915},{"style":813},[1916],{"type":47,"value":1044},{"type":41,"tag":456,"props":1918,"children":1919},{"style":784},[1920],{"type":47,"value":821},{"type":41,"tag":456,"props":1922,"children":1923},{"style":778},[1924],{"type":47,"value":1925},"not Brev",{"type":41,"tag":456,"props":1927,"children":1928},{"style":784},[1929],{"type":47,"value":831},{"type":41,"tag":1080,"props":1931,"children":1932},{},[1933,1971],{"type":41,"tag":531,"props":1934,"children":1935},{},[1936,1940,1942,1956,1958,1963,1965,1970],{"type":41,"tag":374,"props":1937,"children":1938},{},[1939],{"type":47,"value":1925},{"type":47,"value":1941}," → skip the rest of this step and ",{"type":41,"tag":374,"props":1943,"children":1944},{},[1945,1947],{"type":47,"value":1946},"do not read ",{"type":41,"tag":215,"props":1948,"children":1950},{"href":1949},"references\u002Fbrev.md",[1951],{"type":41,"tag":96,"props":1952,"children":1954},{"className":1953},[],[1955],{"type":47,"value":1949},{"type":47,"value":1957},"; keep the normal ",{"type":41,"tag":96,"props":1959,"children":1961},{"className":1960},[],[1962],{"type":47,"value":1524},{"type":47,"value":1964},"-based ",{"type":41,"tag":96,"props":1966,"children":1968},{"className":1967},[],[1969],{"type":47,"value":1513},{"type":47,"value":648},{"type":41,"tag":531,"props":1972,"children":1973},{},[1974,1978,1980,1991,1992,1997,1999,2004,2006,2011,2012,2017,2019,2024,2026,2032,2033,2039,2040,2046,2048,2053,2055,2061],{"type":41,"tag":374,"props":1975,"children":1976},{},[1977],{"type":47,"value":1903},{"type":47,"value":1979}," → apply the Brev secure-link overrides from ",{"type":41,"tag":215,"props":1981,"children":1983},{"href":1982},"references\u002Fbrev.md#setup-flow",[1984,1989],{"type":41,"tag":96,"props":1985,"children":1987},{"className":1986},[],[1988],{"type":47,"value":1949},{"type":47,"value":1990}," § Setup flow",{"type":47,"value":428},{"type":41,"tag":96,"props":1993,"children":1995},{"className":1994},[],[1996],{"type":47,"value":434},{"type":47,"value":1998}," (NOT ",{"type":41,"tag":96,"props":2000,"children":2002},{"className":2001},[],[2003],{"type":47,"value":426},{"type":47,"value":2005},"). Those set ",{"type":41,"tag":96,"props":2007,"children":2009},{"className":2008},[],[2010],{"type":47,"value":1513},{"type":47,"value":1093},{"type":41,"tag":96,"props":2013,"children":2015},{"className":2014},[],[2016],{"type":47,"value":1597},{"type":47,"value":2018}," to the secure-link domain ",{"type":41,"tag":374,"props":2020,"children":2021},{},[2022],{"type":47,"value":2023},"and",{"type":47,"value":2025}," ",{"type":41,"tag":96,"props":2027,"children":2029},{"className":2028},[],[2030],{"type":47,"value":2031},"VSS_PUBLIC_HTTP_PROTOCOL=https",{"type":47,"value":1093},{"type":41,"tag":96,"props":2034,"children":2036},{"className":2035},[],[2037],{"type":47,"value":2038},"VSS_PUBLIC_WS_PROTOCOL=wss",{"type":47,"value":1093},{"type":41,"tag":96,"props":2041,"children":2043},{"className":2042},[],[2044],{"type":47,"value":2045},"VSS_PUBLIC_PORT=443",{"type":47,"value":2047}," — setting ",{"type":41,"tag":96,"props":2049,"children":2051},{"className":2050},[],[2052],{"type":47,"value":1513},{"type":47,"value":2054}," alone leaves ",{"type":41,"tag":96,"props":2056,"children":2058},{"className":2057},[],[2059],{"type":47,"value":2060},"http:\u002F\u002F…:7777",{"type":47,"value":2062}," UI\u002FAPI\u002FWS links that the browser blocks as mixed content.",{"type":41,"tag":696,"props":2064,"children":2066},{"id":2065},"step-2-build-env_overrides",[2067],{"type":47,"value":2068},"Step 2 — Build env_overrides",{"type":41,"tag":162,"props":2070,"children":2071},{},[2072,2074,2080,2082,2088,2089,2095,2097,2102,2104,2113],{"type":47,"value":2073},"Produce an ",{"type":41,"tag":96,"props":2075,"children":2077},{"className":2076},[],[2078],{"type":47,"value":2079},"env_overrides",{"type":47,"value":2081}," dict from the user request and the gathered\ncontext: explicitly choose remote\u002Flocal LLM\u002FVLM, set credentials, point at\nendpoints, set platform-specific flags. Do not let existing shell env vars\nsilently pick placement; write the selected ",{"type":41,"tag":96,"props":2083,"children":2085},{"className":2084},[],[2086],{"type":47,"value":2087},"LLM_MODE",{"type":47,"value":1093},{"type":41,"tag":96,"props":2090,"children":2092},{"className":2091},[],[2093],{"type":47,"value":2094},"VLM_MODE",{"type":47,"value":2096}," and\nmatching endpoint\u002Fmodel fields into ",{"type":41,"tag":96,"props":2098,"children":2100},{"className":2099},[],[2101],{"type":47,"value":434},{"type":47,"value":2103},". The full mapping (every\noverride key, when it applies, defaults, profile-specific differences) lives\nin ",{"type":41,"tag":215,"props":2105,"children":2107},{"href":2106},"references\u002Fenv-overrides.md",[2108],{"type":41,"tag":96,"props":2109,"children":2111},{"className":2110},[],[2112],{"type":47,"value":2106},{"type":47,"value":2114},". Each profile\nreference has worked examples for that profile's common scenarios.",{"type":41,"tag":696,"props":2116,"children":2118},{"id":2117},"step-3-apply-overrides-dry-run",[2119],{"type":47,"value":2120},"Step 3 — Apply overrides + dry-run",{"type":41,"tag":162,"props":2122,"children":2123},{},[2124,2129,2130,2136],{"type":41,"tag":374,"props":2125,"children":2126},{},[2127],{"type":47,"value":2128},"Working env file:",{"type":47,"value":2025},{"type":41,"tag":96,"props":2131,"children":2133},{"className":2132},[],[2134],{"type":47,"value":2135},"\u003Crepo>\u002Fdeploy\u002Fdocker\u002Fdeveloper-profiles\u002Fdev-profile-\u003Cprofile>\u002Fgenerated.env",{"type":47,"value":2137}," (created in Step 1c).",{"type":41,"tag":1190,"props":2139,"children":2140},{},[2141],{"type":41,"tag":162,"props":2142,"children":2143},{},[2144,2149,2151,2156,2158,2163,2165,2171],{"type":41,"tag":374,"props":2145,"children":2146},{},[2147],{"type":47,"value":2148},"Reminder (see Step 1c):",{"type":47,"value":2150}," apply all overrides (Step 2 dict + Brev ",{"type":41,"tag":96,"props":2152,"children":2154},{"className":2153},[],[2155],{"type":47,"value":1513},{"type":47,"value":2157},") to ",{"type":41,"tag":96,"props":2159,"children":2161},{"className":2160},[],[2162],{"type":47,"value":434},{"type":47,"value":2164},"; ",{"type":41,"tag":96,"props":2166,"children":2168},{"className":2167},[],[2169],{"type":47,"value":2170},"--env-file",{"type":47,"value":2172}," always points at it, and post-deploy verifiers read it for the actually-deployed values.",{"type":41,"tag":445,"props":2174,"children":2176},{"className":447,"code":2175,"language":449,"meta":450,"style":450},"# (Step 1c already ran: cp $ENV_SRC $ENV_GEN)\n\n# Apply the env_overrides dict from Step 2 to generated.env\n# (read lines, update matching keys, append new keys, write)\n# Example:\n#   sed -i \"s|^LLM_MODE=.*|LLM_MODE=remote|\" \"$ENV_GEN\"\n#   sed -i \"s|^LLM_BASE_URL=.*|LLM_BASE_URL=http:\u002F\u002Flocalhost:30081|\" \"$ENV_GEN\"\n\n# Resolve compose\ncd $REPO\u002Fdeploy\u002Fdocker\ndocker compose --env-file $ENV_GEN config > resolved.yml\n",[2177],{"type":41,"tag":96,"props":2178,"children":2179},{"__ignoreMap":450},[2180,2188,2195,2203,2211,2219,2228,2237,2245,2254,2273],{"type":41,"tag":456,"props":2181,"children":2182},{"class":458,"line":459},[2183],{"type":41,"tag":456,"props":2184,"children":2185},{"style":463},[2186],{"type":47,"value":2187},"# (Step 1c already ran: cp $ENV_SRC $ENV_GEN)\n",{"type":41,"tag":456,"props":2189,"children":2190},{"class":458,"line":469},[2191],{"type":41,"tag":456,"props":2192,"children":2193},{"emptyLinePlaceholder":1743},[2194],{"type":47,"value":1746},{"type":41,"tag":456,"props":2196,"children":2197},{"class":458,"line":478},[2198],{"type":41,"tag":456,"props":2199,"children":2200},{"style":463},[2201],{"type":47,"value":2202},"# Apply the env_overrides dict from Step 2 to generated.env\n",{"type":41,"tag":456,"props":2204,"children":2205},{"class":458,"line":487},[2206],{"type":41,"tag":456,"props":2207,"children":2208},{"style":463},[2209],{"type":47,"value":2210},"# (read lines, update matching keys, append new keys, write)\n",{"type":41,"tag":456,"props":2212,"children":2213},{"class":458,"line":496},[2214],{"type":41,"tag":456,"props":2215,"children":2216},{"style":463},[2217],{"type":47,"value":2218},"# Example:\n",{"type":41,"tag":456,"props":2220,"children":2222},{"class":458,"line":2221},6,[2223],{"type":41,"tag":456,"props":2224,"children":2225},{"style":463},[2226],{"type":47,"value":2227},"#   sed -i \"s|^LLM_MODE=.*|LLM_MODE=remote|\" \"$ENV_GEN\"\n",{"type":41,"tag":456,"props":2229,"children":2231},{"class":458,"line":2230},7,[2232],{"type":41,"tag":456,"props":2233,"children":2234},{"style":463},[2235],{"type":47,"value":2236},"#   sed -i \"s|^LLM_BASE_URL=.*|LLM_BASE_URL=http:\u002F\u002Flocalhost:30081|\" \"$ENV_GEN\"\n",{"type":41,"tag":456,"props":2238,"children":2240},{"class":458,"line":2239},8,[2241],{"type":41,"tag":456,"props":2242,"children":2243},{"emptyLinePlaceholder":1743},[2244],{"type":47,"value":1746},{"type":41,"tag":456,"props":2246,"children":2248},{"class":458,"line":2247},9,[2249],{"type":41,"tag":456,"props":2250,"children":2251},{"style":463},[2252],{"type":47,"value":2253},"# Resolve compose\n",{"type":41,"tag":456,"props":2255,"children":2257},{"class":458,"line":2256},10,[2258,2263,2268],{"type":41,"tag":456,"props":2259,"children":2260},{"style":813},[2261],{"type":47,"value":2262},"cd",{"type":41,"tag":456,"props":2264,"children":2265},{"style":968},[2266],{"type":47,"value":2267}," $REPO",{"type":41,"tag":456,"props":2269,"children":2270},{"style":778},[2271],{"type":47,"value":2272},"\u002Fdeploy\u002Fdocker\n",{"type":41,"tag":456,"props":2274,"children":2276},{"class":458,"line":2275},11,[2277,2281,2286,2291,2296,2301,2305],{"type":41,"tag":456,"props":2278,"children":2279},{"style":772},[2280],{"type":47,"value":932},{"type":41,"tag":456,"props":2282,"children":2283},{"style":778},[2284],{"type":47,"value":2285}," compose",{"type":41,"tag":456,"props":2287,"children":2288},{"style":778},[2289],{"type":47,"value":2290}," --env-file",{"type":41,"tag":456,"props":2292,"children":2293},{"style":968},[2294],{"type":47,"value":2295}," $ENV_GEN ",{"type":41,"tag":456,"props":2297,"children":2298},{"style":778},[2299],{"type":47,"value":2300},"config",{"type":41,"tag":456,"props":2302,"children":2303},{"style":784},[2304],{"type":47,"value":1019},{"type":41,"tag":456,"props":2306,"children":2307},{"style":778},[2308],{"type":47,"value":2309}," resolved.yml\n",{"type":41,"tag":162,"props":2311,"children":2312},{},[2313,2315,2321],{"type":47,"value":2314},"The resolved YAML is saved to ",{"type":41,"tag":96,"props":2316,"children":2318},{"className":2317},[],[2319],{"type":47,"value":2320},"\u003Crepo>\u002Fdeploy\u002Fdocker\u002Fresolved.yml",{"type":47,"value":648},{"type":41,"tag":696,"props":2323,"children":2325},{"id":2324},"step-3b-verify-resolvedyml-has-no-unexpanded-tokens",[2326],{"type":47,"value":2327},"Step 3b — Verify resolved.yml has no unexpanded ${...} tokens",{"type":41,"tag":162,"props":2329,"children":2330},{},[2331,2333,2339,2341,2346,2348,2357],{"type":47,"value":2332},"Unexpanded ",{"type":41,"tag":96,"props":2334,"children":2336},{"className":2335},[],[2337],{"type":47,"value":2338},"${VAR}",{"type":47,"value":2340}," tokens in ",{"type":41,"tag":96,"props":2342,"children":2344},{"className":2343},[],[2345],{"type":47,"value":120},{"type":47,"value":2347}," mean compose did not see those env values. Diagnostic procedure and common culprits live in ",{"type":41,"tag":215,"props":2349,"children":2351},{"href":2350},"references\u002Ftroubleshooting.md",[2352],{"type":41,"tag":96,"props":2353,"children":2355},{"className":2354},[],[2356],{"type":47,"value":2350},{"type":47,"value":648},{"type":41,"tag":696,"props":2359,"children":2361},{"id":2360},"step-3c-verify-access-to-selected-ngc-artifacts",[2362],{"type":47,"value":2363},"Step 3c — Verify access to selected NGC artifacts",{"type":41,"tag":162,"props":2365,"children":2366},{},[2367,2369,2374,2376,2381],{"type":47,"value":2368},"Do this after ",{"type":41,"tag":96,"props":2370,"children":2372},{"className":2371},[],[2373],{"type":47,"value":120},{"type":47,"value":2375}," exists and before ",{"type":41,"tag":96,"props":2377,"children":2379},{"className":2378},[],[2380],{"type":47,"value":1577},{"type":47,"value":2382},". The NGC\ntoken probe in Step 0a proves only that the key authenticates; it does not\nprove the key's org\u002Fteam can access the selected image or model repositories.",{"type":41,"tag":162,"props":2384,"children":2385},{},[2386],{"type":47,"value":2387},"Build the artifact list from the actual selected deployment:",{"type":41,"tag":1080,"props":2389,"children":2390},{},[2391,2417,2450],{"type":41,"tag":531,"props":2392,"children":2393},{},[2394,2399,2401,2407,2409,2415],{"type":41,"tag":96,"props":2395,"children":2397},{"className":2396},[],[2398],{"type":47,"value":120},{"type":47,"value":2400},": every ",{"type":41,"tag":96,"props":2402,"children":2404},{"className":2403},[],[2405],{"type":47,"value":2406},"image:",{"type":47,"value":2408}," under ",{"type":41,"tag":96,"props":2410,"children":2412},{"className":2411},[],[2413],{"type":47,"value":2414},"nvcr.io\u002F...",{"type":47,"value":2416}," that Compose will pull.",{"type":41,"tag":531,"props":2418,"children":2419},{},[2420,2425,2427,2433,2435,2441,2442,2448],{"type":41,"tag":96,"props":2421,"children":2423},{"className":2422},[],[2424],{"type":47,"value":1777},{"type":47,"value":2426},": NGC-backed model\u002Fresource paths such as\n",{"type":41,"tag":96,"props":2428,"children":2430},{"className":2429},[],[2431],{"type":47,"value":2432},"RTVI_VLM_MODEL_PATH=ngc:nim\u002Fnvidia\u002Fcosmos3-nano-reasoner:bf16-final",{"type":47,"value":2434},". Skip\n",{"type":41,"tag":96,"props":2436,"children":2438},{"className":2437},[],[2439],{"type":47,"value":2440},"none",{"type":47,"value":1138},{"type":41,"tag":96,"props":2443,"children":2445},{"className":2444},[],[2446],{"type":47,"value":2447},"git:...",{"type":47,"value":2449},", local paths, and remote endpoint URLs.",{"type":41,"tag":531,"props":2451,"children":2452},{},[2453],{"type":47,"value":2454},"Profile staging steps: any NGC model\u002Fresource downloads documented in the\nprofile reference, such as alerts\u002Fsearch perception model staging.",{"type":41,"tag":162,"props":2456,"children":2457},{},[2458],{"type":47,"value":2459},"Probe each selected artifact with the normalized NGC key before continuing:",{"type":41,"tag":1080,"props":2461,"children":2462},{},[2463,2516,2568],{"type":41,"tag":531,"props":2464,"children":2465},{},[2466,2468,2474,2476,2482,2484,2490,2492,2498,2500,2506,2508,2514],{"type":47,"value":2467},"Container images: ",{"type":41,"tag":96,"props":2469,"children":2471},{"className":2470},[],[2472],{"type":47,"value":2473},"docker manifest inspect \u003Cnvcr.io\u002F...>",{"type":47,"value":2475}," after ",{"type":41,"tag":96,"props":2477,"children":2479},{"className":2478},[],[2480],{"type":47,"value":2481},"docker login nvcr.io",{"type":47,"value":2483}," — for gated ",{"type":41,"tag":96,"props":2485,"children":2487},{"className":2486},[],[2488],{"type":47,"value":2489},"nvcr.io",{"type":47,"value":2491}," repos a ",{"type":41,"tag":96,"props":2493,"children":2495},{"className":2494},[],[2496],{"type":47,"value":2497},"401",{"type":47,"value":2499},"\u002F",{"type":41,"tag":96,"props":2501,"children":2503},{"className":2502},[],[2504],{"type":47,"value":2505},"403",{"type":47,"value":2507}," here is a definitive\nno-entitlement signal (manifest read requires the same org\u002Fteam grant as the\nlayer pull); or the matching ",{"type":41,"tag":96,"props":2509,"children":2511},{"className":2510},[],[2512],{"type":47,"value":2513},"ngc registry image info ...",{"type":47,"value":2515}," when the artifact\nmaps cleanly to an NGC image path.",{"type":41,"tag":531,"props":2517,"children":2518},{},[2519,2521,2527,2529,2535,2537,2543,2545,2551,2553,2558,2560,2566],{"type":47,"value":2520},"NGC model\u002Fresource paths (e.g. the Cosmos checkpoint RT-VLM downloads at\nruntime): run the matching ",{"type":41,"tag":96,"props":2522,"children":2524},{"className":2523},[],[2525],{"type":47,"value":2526},"ngc registry model info ...",{"type":47,"value":2528}," or ",{"type":41,"tag":96,"props":2530,"children":2532},{"className":2531},[],[2533],{"type":47,"value":2534},"ngc registry resource info ...",{"type":47,"value":2536}," for the exact repo\u002Ftag the profile will load or download;\nthese use NGC's scoped auth. Do NOT probe a model with ",{"type":41,"tag":96,"props":2538,"children":2540},{"className":2539},[],[2541],{"type":47,"value":2542},"docker manifest inspect",{"type":47,"value":2544}," (returns \"no such manifest\" because a model is not an OCI image) or a\nraw ",{"type":41,"tag":96,"props":2546,"children":2548},{"className":2547},[],[2549],{"type":47,"value":2550},"Authorization: Bearer \u003Ckey>",{"type":47,"value":2552}," REST call (returns ",{"type":41,"tag":96,"props":2554,"children":2556},{"className":2555},[],[2557],{"type":47,"value":2505},{"type":47,"value":2559}," because that is not\nNGC's auth flow); both are expected false negatives, not entitlement failures.\nIf the ",{"type":41,"tag":96,"props":2561,"children":2563},{"className":2562},[],[2564],{"type":47,"value":2565},"ngc",{"type":47,"value":2567}," CLI is unavailable, treat the container-image probe above as the\nentitlement signal, since NGC grants org\u002Fteam access across images and models\ntogether.",{"type":41,"tag":531,"props":2569,"children":2570},{},[2571,2573,2578,2579,2585],{"type":47,"value":2572},"Profile-staged TAO\u002Fperception models: run the corresponding ",{"type":41,"tag":96,"props":2574,"children":2576},{"className":2575},[],[2577],{"type":47,"value":2526},{"type":47,"value":1093},{"type":41,"tag":96,"props":2580,"children":2582},{"className":2581},[],[2583],{"type":47,"value":2584},"resource info ...",{"type":47,"value":2586}," for each repo\u002Ftag before the staging\nblock downloads files.",{"type":41,"tag":162,"props":2588,"children":2589},{},[2590,2592,2597,2598,2603,2604,2610,2611,2617],{"type":47,"value":2591},"If any probe returns ",{"type":41,"tag":96,"props":2593,"children":2595},{"className":2594},[],[2596],{"type":47,"value":2497},{"type":47,"value":1138},{"type":41,"tag":96,"props":2599,"children":2601},{"className":2600},[],[2602],{"type":47,"value":2505},{"type":47,"value":1138},{"type":41,"tag":96,"props":2605,"children":2607},{"className":2606},[],[2608],{"type":47,"value":2609},"permission",{"type":47,"value":1138},{"type":41,"tag":96,"props":2612,"children":2614},{"className":2613},[],[2615],{"type":47,"value":2616},"not being a member of the organization that owns the repo",{"type":47,"value":2618},", missing org\u002Frepo, or a similar access error,\nstop and prompt the user for an NGC key from an org\u002Fteam entitled to those\nartifacts. Do not start Compose and discover the failure during NIM cold start.",{"type":41,"tag":696,"props":2620,"children":2622},{"id":2621},"step-3d-strip-dangling-optional-depends_on-from-resolvedyml",[2623,2625,2630],{"type":47,"value":2624},"Step 3d — Strip dangling optional ",{"type":41,"tag":96,"props":2626,"children":2628},{"className":2627},[],[2629],{"type":47,"value":112},{"type":47,"value":2631}," from resolved.yml",{"type":41,"tag":162,"props":2633,"children":2634},{},[2635,2640],{"type":41,"tag":374,"props":2636,"children":2637},{},[2638],{"type":47,"value":2639},"MUST run after Step 3, before Step 5.",{"type":47,"value":2641}," Skipping this aborts the deploy:",{"type":41,"tag":162,"props":2643,"children":2644},{},[2645],{"type":47,"value":2646},"Normalize - drop optional dependencies for services filtered out from resolved.yml",{"type":41,"tag":445,"props":2648,"children":2650},{"className":447,"code":2649,"language":449,"meta":450,"style":450},"# From the repo root\nuv run skills\u002Fvss-deploy-profile\u002Fscripts\u002Fnormalize_resolved_yml.py \"$REPO\u002Fdeploy\u002Fdocker\u002Fresolved.yml\"\n",[2651],{"type":41,"tag":96,"props":2652,"children":2653},{"__ignoreMap":450},[2654,2662],{"type":41,"tag":456,"props":2655,"children":2656},{"class":458,"line":459},[2657],{"type":41,"tag":456,"props":2658,"children":2659},{"style":463},[2660],{"type":47,"value":2661},"# From the repo root\n",{"type":41,"tag":456,"props":2663,"children":2664},{"class":458,"line":469},[2665,2670,2674,2679,2683,2687,2692],{"type":41,"tag":456,"props":2666,"children":2667},{"style":772},[2668],{"type":47,"value":2669},"uv",{"type":41,"tag":456,"props":2671,"children":2672},{"style":778},[2673],{"type":47,"value":989},{"type":41,"tag":456,"props":2675,"children":2676},{"style":778},[2677],{"type":47,"value":2678}," skills\u002Fvss-deploy-profile\u002Fscripts\u002Fnormalize_resolved_yml.py",{"type":41,"tag":456,"props":2680,"children":2681},{"style":784},[2682],{"type":47,"value":821},{"type":41,"tag":456,"props":2684,"children":2685},{"style":968},[2686],{"type":47,"value":554},{"type":41,"tag":456,"props":2688,"children":2689},{"style":778},[2690],{"type":47,"value":2691},"\u002Fdeploy\u002Fdocker\u002Fresolved.yml",{"type":41,"tag":456,"props":2693,"children":2694},{"style":784},[2695],{"type":47,"value":831},{"type":41,"tag":162,"props":2697,"children":2698},{},[2699,2701,2706,2708,2714,2716,2721,2723,2729],{"type":47,"value":2700},"If ",{"type":41,"tag":96,"props":2702,"children":2704},{"className":2703},[],[2705],{"type":47,"value":2669},{"type":47,"value":2707}," isn't on the host, install it once with ",{"type":41,"tag":96,"props":2709,"children":2711},{"className":2710},[],[2712],{"type":47,"value":2713},"curl -LsSf https:\u002F\u002Fastral.sh\u002Fuv\u002Finstall.sh | sh",{"type":47,"value":2715}," (no root needed).\n",{"type":41,"tag":374,"props":2717,"children":2718},{},[2719],{"type":47,"value":2720},"Re-validate",{"type":47,"value":2722}," before ",{"type":41,"tag":96,"props":2724,"children":2726},{"className":2725},[],[2727],{"type":47,"value":2728},"up -d",{"type":47,"value":2730},":",{"type":41,"tag":445,"props":2732,"children":2734},{"className":447,"code":2733,"language":449,"meta":450,"style":450},"docker compose -f \"$REPO\u002Fdeploy\u002Fdocker\u002Fresolved.yml\" config --quiet && echo \"resolved.yml OK\"\n",[2735],{"type":41,"tag":96,"props":2736,"children":2737},{"__ignoreMap":450},[2738],{"type":41,"tag":456,"props":2739,"children":2740},{"class":458,"line":459},[2741,2745,2749,2754,2758,2762,2766,2770,2775,2780,2784,2788,2792,2797],{"type":41,"tag":456,"props":2742,"children":2743},{"style":772},[2744],{"type":47,"value":932},{"type":41,"tag":456,"props":2746,"children":2747},{"style":778},[2748],{"type":47,"value":2285},{"type":41,"tag":456,"props":2750,"children":2751},{"style":778},[2752],{"type":47,"value":2753}," -f",{"type":41,"tag":456,"props":2755,"children":2756},{"style":784},[2757],{"type":47,"value":821},{"type":41,"tag":456,"props":2759,"children":2760},{"style":968},[2761],{"type":47,"value":554},{"type":41,"tag":456,"props":2763,"children":2764},{"style":778},[2765],{"type":47,"value":2691},{"type":41,"tag":456,"props":2767,"children":2768},{"style":784},[2769],{"type":47,"value":1768},{"type":41,"tag":456,"props":2771,"children":2772},{"style":778},[2773],{"type":47,"value":2774}," config",{"type":41,"tag":456,"props":2776,"children":2777},{"style":778},[2778],{"type":47,"value":2779}," --quiet",{"type":41,"tag":456,"props":2781,"children":2782},{"style":784},[2783],{"type":47,"value":1890},{"type":41,"tag":456,"props":2785,"children":2786},{"style":813},[2787],{"type":47,"value":1044},{"type":41,"tag":456,"props":2789,"children":2790},{"style":784},[2791],{"type":47,"value":821},{"type":41,"tag":456,"props":2793,"children":2794},{"style":778},[2795],{"type":47,"value":2796},"resolved.yml OK",{"type":41,"tag":456,"props":2798,"children":2799},{"style":784},[2800],{"type":47,"value":831},{"type":41,"tag":162,"props":2802,"children":2803},{},[2804],{"type":47,"value":2805},"If validation still fails after the normalizer runs, capture the error and inspect — that's a different bug (a dependency that's not optional, or another schema violation), not the dangling-depends_on case.",{"type":41,"tag":696,"props":2807,"children":2809},{"id":2808},"step-4-review",[2810],{"type":47,"value":2811},"Step 4 — Review",{"type":41,"tag":162,"props":2813,"children":2814},{},[2815],{"type":47,"value":2816},"Show the user a summary of what will be deployed:",{"type":41,"tag":1080,"props":2818,"children":2819},{},[2820,2825,2830,2835,2840],{"type":41,"tag":531,"props":2821,"children":2822},{},[2823],{"type":47,"value":2824},"Profile name and hardware",{"type":41,"tag":531,"props":2826,"children":2827},{},[2828],{"type":47,"value":2829},"LLM\u002FVLM models and mode (local\u002Fremote\u002Flocal_shared)",{"type":41,"tag":531,"props":2831,"children":2832},{},[2833],{"type":47,"value":2834},"Services that will start",{"type":41,"tag":531,"props":2836,"children":2837},{},[2838],{"type":47,"value":2839},"GPU device assignment",{"type":41,"tag":531,"props":2841,"children":2842},{},[2843],{"type":47,"value":2844},"Key endpoints (UI port, agent port)",{"type":41,"tag":162,"props":2846,"children":2847},{},[2848,2850,2855],{"type":47,"value":2849},"Ask: ",{"type":41,"tag":374,"props":2851,"children":2852},{},[2853],{"type":47,"value":2854},"\"Looks good — deploy now?\"",{"type":47,"value":2856}," and wait for confirmation before Step 5.",{"type":41,"tag":162,"props":2858,"children":2859},{},[2860,2865],{"type":41,"tag":374,"props":2861,"children":2862},{},[2863],{"type":47,"value":2864},"Exception — autonomous mode.",{"type":47,"value":2866}," If the user's request already asks you to run autonomously (e.g. \"deploy X autonomously\", \"run without confirmation\", \"non-interactive\"), skip the confirmation prompt and proceed straight to Step 5. This path exists so automated eval \u002F CI invocations don't hang waiting for a human reply they'll never get. In all other cases, a human must approve.",{"type":41,"tag":696,"props":2868,"children":2870},{"id":2869},"step-5-deploy",[2871],{"type":47,"value":2872},"Step 5 — Deploy",{"type":41,"tag":445,"props":2874,"children":2876},{"className":447,"code":2875,"language":449,"meta":450,"style":450},"cd $REPO\u002Fdeploy\u002Fdocker\ndocker compose --env-file $ENV_GEN -f resolved.yml up -d\n",[2877],{"type":41,"tag":96,"props":2878,"children":2879},{"__ignoreMap":450},[2880,2895],{"type":41,"tag":456,"props":2881,"children":2882},{"class":458,"line":459},[2883,2887,2891],{"type":41,"tag":456,"props":2884,"children":2885},{"style":813},[2886],{"type":47,"value":2262},{"type":41,"tag":456,"props":2888,"children":2889},{"style":968},[2890],{"type":47,"value":2267},{"type":41,"tag":456,"props":2892,"children":2893},{"style":778},[2894],{"type":47,"value":2272},{"type":41,"tag":456,"props":2896,"children":2897},{"class":458,"line":469},[2898,2902,2906,2910,2914,2919,2924,2929],{"type":41,"tag":456,"props":2899,"children":2900},{"style":772},[2901],{"type":47,"value":932},{"type":41,"tag":456,"props":2903,"children":2904},{"style":778},[2905],{"type":47,"value":2285},{"type":41,"tag":456,"props":2907,"children":2908},{"style":778},[2909],{"type":47,"value":2290},{"type":41,"tag":456,"props":2911,"children":2912},{"style":968},[2913],{"type":47,"value":2295},{"type":41,"tag":456,"props":2915,"children":2916},{"style":778},[2917],{"type":47,"value":2918},"-f",{"type":41,"tag":456,"props":2920,"children":2921},{"style":778},[2922],{"type":47,"value":2923}," resolved.yml",{"type":41,"tag":456,"props":2925,"children":2926},{"style":778},[2927],{"type":47,"value":2928}," up",{"type":41,"tag":456,"props":2930,"children":2931},{"style":778},[2932],{"type":47,"value":2933}," -d\n",{"type":41,"tag":1190,"props":2935,"children":2936},{},[2937],{"type":41,"tag":162,"props":2938,"children":2939},{},[2940,2950,2952,2957,2959,2965,2967,2972],{"type":41,"tag":374,"props":2941,"children":2942},{},[2943,2948],{"type":41,"tag":96,"props":2944,"children":2946},{"className":2945},[],[2947],{"type":47,"value":2170},{"type":47,"value":2949}," is mandatory.",{"type":47,"value":2951}," Without the same ",{"type":41,"tag":96,"props":2953,"children":2955},{"className":2954},[],[2956],{"type":47,"value":434},{"type":47,"value":2958}," used in Step 3, ",{"type":41,"tag":96,"props":2960,"children":2962},{"className":2961},[],[2963],{"type":47,"value":2964},"COMPOSE_PROFILES",{"type":47,"value":2966}," may be unset and ",{"type":41,"tag":96,"props":2968,"children":2970},{"className":2969},[],[2971],{"type":47,"value":2728},{"type":47,"value":2973}," can exit 0 with zero selected services.",{"type":41,"tag":1190,"props":2975,"children":2976},{},[2977],{"type":41,"tag":162,"props":2978,"children":2979},{},[2980,2993,2995,3000,3002,3008],{"type":41,"tag":374,"props":2981,"children":2982},{},[2983,2985,2991],{"type":47,"value":2984},"Avoid broad ",{"type":41,"tag":96,"props":2986,"children":2988},{"className":2987},[],[2989],{"type":47,"value":2990},"--force-recreate",{"type":47,"value":2992}," on ordinary retries",{"type":47,"value":2994}," — it destroys warm\nNIM containers (another 3–5 min torch.compile + CUDA-graph capture each).\nFix the root cause (usually perms or an env typo) and just re-run ",{"type":41,"tag":96,"props":2996,"children":2998},{"className":2997},[],[2999],{"type":47,"value":2728},{"type":47,"value":3001},";\nuse targeted ",{"type":41,"tag":96,"props":3003,"children":3005},{"className":3004},[],[3006],{"type":47,"value":3007},"--force-recreate --no-deps \u003Cservice...>",{"type":47,"value":3009}," only when a profile\nreference documents it as the recovery path.",{"type":41,"tag":162,"props":3011,"children":3012},{},[3013,3019],{"type":41,"tag":96,"props":3014,"children":3016},{"className":3015},[],[3017],{"type":47,"value":3018},"docker compose up -d",{"type":47,"value":3020}," only creates containers; it does not wait for internal services to finish warming. Never declare deploy success until the readiness gates pass.",{"type":41,"tag":696,"props":3022,"children":3024},{"id":3023},"step-5b-wait-until-the-stack-is-actually-healthy",[3025],{"type":47,"value":3026},"Step 5b — Wait until the stack is actually healthy",{"type":41,"tag":162,"props":3028,"children":3029},{},[3030,3035,3037,3042,3044,3050,3052,3058,3060,3065,3067,3076],{"type":41,"tag":374,"props":3031,"children":3032},{},[3033],{"type":47,"value":3034},"Gate 0 — container count must be > 0.",{"type":47,"value":3036}," Refuse to proceed past ",{"type":41,"tag":96,"props":3038,"children":3040},{"className":3039},[],[3041],{"type":47,"value":2728},{"type":47,"value":3043}," until the started count (",{"type":41,"tag":96,"props":3045,"children":3047},{"className":3046},[],[3048],{"type":47,"value":3049},"docker compose -f resolved.yml ps -q | wc -l",{"type":47,"value":3051},") is non-zero and ≥ the expected count (",{"type":41,"tag":96,"props":3053,"children":3055},{"className":3054},[],[3056],{"type":47,"value":3057},"config --services | wc -l",{"type":47,"value":3059},"); a zero\u002Fshort count almost always means a missing ",{"type":41,"tag":96,"props":3061,"children":3063},{"className":3062},[],[3064],{"type":47,"value":2170},{"type":47,"value":3066}," in Step 5. The exact gate plus the full readiness procedure live in ",{"type":41,"tag":215,"props":3068,"children":3070},{"href":3069},"references\u002Freadiness.md",[3071],{"type":41,"tag":96,"props":3072,"children":3074},{"className":3073},[],[3075],{"type":47,"value":3069},{"type":47,"value":648},{"type":41,"tag":162,"props":3078,"children":3079},{},[3080,3082],{"type":47,"value":3081},"Cold deploys can take 10–20 min, and each profile reference lists the required endpoints. ",{"type":41,"tag":374,"props":3083,"children":3084},{},[3085,3087,3092],{"type":47,"value":3086},"Never declare deploy done after ",{"type":41,"tag":96,"props":3088,"children":3090},{"className":3089},[],[3091],{"type":47,"value":2728},{"type":47,"value":3093},"; only after every documented endpoint succeeds.",{"type":41,"tag":50,"props":3095,"children":3097},{"id":3096},"tear-down",[3098],{"type":47,"value":3099},"Tear Down",{"type":41,"tag":162,"props":3101,"children":3102},{},[3103,3105,3113,3115,3121,3123,3129,3131,3137],{"type":47,"value":3104},"To tear down a deployment — full host reclaim or cache-preserving redeploy \u002F profile\nswitch — follow ",{"type":41,"tag":215,"props":3106,"children":3107},{"href":1241},[3108],{"type":41,"tag":96,"props":3109,"children":3111},{"className":3110},[],[3112],{"type":47,"value":1241},{"type":47,"value":3114},". Always tear down\nby the ",{"type":41,"tag":96,"props":3116,"children":3118},{"className":3117},[],[3119],{"type":47,"value":3120},"mdx",{"type":47,"value":3122}," project with ",{"type":41,"tag":96,"props":3124,"children":3126},{"className":3125},[],[3127],{"type":47,"value":3128},"-v --remove-orphans",{"type":47,"value":3130},"; a plain ",{"type":41,"tag":96,"props":3132,"children":3134},{"className":3133},[],[3135],{"type":47,"value":3136},"docker compose down",{"type":47,"value":3138}," leaves\nvolumes and networks behind.",{"type":41,"tag":50,"props":3140,"children":3142},{"id":3141},"debugging-a-deployment",[3143],{"type":47,"value":3144},"Debugging a Deployment",{"type":41,"tag":162,"props":3146,"children":3147},{},[3148],{"type":47,"value":3149},"Use this workflow when the user asks to \"debug the deploy\", \"verify it's working\", \"why is the agent not responding\", or similar. The goal is to confirm the full video-ingestion-to-agent-answer path, not just that containers are \"Up\".",{"type":41,"tag":162,"props":3151,"children":3152},{},[3153,3155,3160],{"type":47,"value":3154},"Each profile reference has a ",{"type":41,"tag":374,"props":3156,"children":3157},{},[3158],{"type":47,"value":3159},"Debugging",{"type":47,"value":3161}," section listing the exact commands and failure-mode table for that profile.",{"type":41,"tag":696,"props":3163,"children":3165},{"id":3164},"quick-checks-all-profiles",[3166],{"type":47,"value":3167},"Quick checks (all profiles)",{"type":41,"tag":445,"props":3169,"children":3171},{"className":447,"code":3170,"language":449,"meta":450,"style":450},"# 1. All expected containers Up\ndocker ps --format 'table {{.Names}}\\t{{.Status}}'\n\n# 2. Agent API + UI responding\ncurl -sf http:\u002F\u002Flocalhost:8000\u002Fhealth >\u002Fdev\u002Fnull && echo \"agent OK\"\ncurl -sf http:\u002F\u002Flocalhost:3000\u002F >\u002Fdev\u002Fnull && echo \"ui OK\"\n",[3172],{"type":41,"tag":96,"props":3173,"children":3174},{"__ignoreMap":450},[3175,3183,3214,3221,3229,3276],{"type":41,"tag":456,"props":3176,"children":3177},{"class":458,"line":459},[3178],{"type":41,"tag":456,"props":3179,"children":3180},{"style":463},[3181],{"type":47,"value":3182},"# 1. All expected containers Up\n",{"type":41,"tag":456,"props":3184,"children":3185},{"class":458,"line":469},[3186,3190,3195,3200,3204,3209],{"type":41,"tag":456,"props":3187,"children":3188},{"style":772},[3189],{"type":47,"value":932},{"type":41,"tag":456,"props":3191,"children":3192},{"style":778},[3193],{"type":47,"value":3194}," ps",{"type":41,"tag":456,"props":3196,"children":3197},{"style":778},[3198],{"type":47,"value":3199}," --format",{"type":41,"tag":456,"props":3201,"children":3202},{"style":784},[3203],{"type":47,"value":1870},{"type":41,"tag":456,"props":3205,"children":3206},{"style":778},[3207],{"type":47,"value":3208},"table {{.Names}}\\t{{.Status}}",{"type":41,"tag":456,"props":3210,"children":3211},{"style":784},[3212],{"type":47,"value":3213},"'\n",{"type":41,"tag":456,"props":3215,"children":3216},{"class":458,"line":478},[3217],{"type":41,"tag":456,"props":3218,"children":3219},{"emptyLinePlaceholder":1743},[3220],{"type":47,"value":1746},{"type":41,"tag":456,"props":3222,"children":3223},{"class":458,"line":487},[3224],{"type":41,"tag":456,"props":3225,"children":3226},{"style":463},[3227],{"type":47,"value":3228},"# 2. Agent API + UI responding\n",{"type":41,"tag":456,"props":3230,"children":3231},{"class":458,"line":496},[3232,3237,3242,3247,3251,3255,3259,3263,3267,3272],{"type":41,"tag":456,"props":3233,"children":3234},{"style":772},[3235],{"type":47,"value":3236},"curl",{"type":41,"tag":456,"props":3238,"children":3239},{"style":778},[3240],{"type":47,"value":3241}," -sf",{"type":41,"tag":456,"props":3243,"children":3244},{"style":778},[3245],{"type":47,"value":3246}," http:\u002F\u002Flocalhost:8000\u002Fhealth",{"type":41,"tag":456,"props":3248,"children":3249},{"style":784},[3250],{"type":47,"value":1019},{"type":41,"tag":456,"props":3252,"children":3253},{"style":778},[3254],{"type":47,"value":797},{"type":41,"tag":456,"props":3256,"children":3257},{"style":784},[3258],{"type":47,"value":1890},{"type":41,"tag":456,"props":3260,"children":3261},{"style":813},[3262],{"type":47,"value":1044},{"type":41,"tag":456,"props":3264,"children":3265},{"style":784},[3266],{"type":47,"value":821},{"type":41,"tag":456,"props":3268,"children":3269},{"style":778},[3270],{"type":47,"value":3271},"agent OK",{"type":41,"tag":456,"props":3273,"children":3274},{"style":784},[3275],{"type":47,"value":831},{"type":41,"tag":456,"props":3277,"children":3278},{"class":458,"line":2221},[3279,3283,3287,3292,3296,3300,3304,3308,3312,3317],{"type":41,"tag":456,"props":3280,"children":3281},{"style":772},[3282],{"type":47,"value":3236},{"type":41,"tag":456,"props":3284,"children":3285},{"style":778},[3286],{"type":47,"value":3241},{"type":41,"tag":456,"props":3288,"children":3289},{"style":778},[3290],{"type":47,"value":3291}," http:\u002F\u002Flocalhost:3000\u002F",{"type":41,"tag":456,"props":3293,"children":3294},{"style":784},[3295],{"type":47,"value":1019},{"type":41,"tag":456,"props":3297,"children":3298},{"style":778},[3299],{"type":47,"value":797},{"type":41,"tag":456,"props":3301,"children":3302},{"style":784},[3303],{"type":47,"value":1890},{"type":41,"tag":456,"props":3305,"children":3306},{"style":813},[3307],{"type":47,"value":1044},{"type":41,"tag":456,"props":3309,"children":3310},{"style":784},[3311],{"type":47,"value":821},{"type":41,"tag":456,"props":3313,"children":3314},{"style":778},[3315],{"type":47,"value":3316},"ui OK",{"type":41,"tag":456,"props":3318,"children":3319},{"style":784},[3320],{"type":47,"value":831},{"type":41,"tag":162,"props":3322,"children":3323},{},[3324,3326,3332,3334,3340,3342,3348,3350,3355,3357,3366],{"type":47,"value":3325},"The LLM\u002FVLM NIM probes — including the ",{"type":41,"tag":96,"props":3327,"children":3329},{"className":3328},[],[3330],{"type":47,"value":3331},"*_MODE=remote",{"type":47,"value":3333}," handling that skips\n",{"type":41,"tag":96,"props":3335,"children":3337},{"className":3336},[],[3338],{"type":47,"value":3339},"localhost:3008x",{"type":47,"value":3341}," (where a connection refused is expected) and probes the\nselected ",{"type":41,"tag":96,"props":3343,"children":3345},{"className":3344},[],[3346],{"type":47,"value":3347},"*_BASE_URL\u002Fv1\u002Fmodels",{"type":47,"value":3349}," via ",{"type":41,"tag":96,"props":3351,"children":3353},{"className":3352},[],[3354],{"type":47,"value":144},{"type":47,"value":3356}," — are in\n",{"type":41,"tag":215,"props":3358,"children":3360},{"href":3359},"references\u002Ftroubleshooting.md#nim-probes",[3361],{"type":41,"tag":96,"props":3362,"children":3364},{"className":3363},[],[3365],{"type":47,"value":2350},{"type":47,"value":648},{"type":41,"tag":50,"props":3368,"children":3370},{"id":3369},"limitations",[3371],{"type":47,"value":3372},"Limitations",{"type":41,"tag":1080,"props":3374,"children":3375},{},[3376,3389,3394],{"type":41,"tag":531,"props":3377,"children":3378},{},[3379,3381,3387],{"type":47,"value":3380},"This skill deploys compose-based VSS profiles only; standalone microservice deployment belongs to the matching ",{"type":41,"tag":96,"props":3382,"children":3384},{"className":3383},[],[3385],{"type":47,"value":3386},"vss-deploy-*",{"type":47,"value":3388}," skill.",{"type":41,"tag":531,"props":3390,"children":3391},{},[3392],{"type":47,"value":3393},"Hardware sizing, model placement, and profile-specific readiness are owned by profile references; do not infer them from memory.",{"type":41,"tag":531,"props":3395,"children":3396},{},[3397],{"type":47,"value":3398},"Privileged host remediation requires user approval when passwordless sudo is unavailable.",{"type":41,"tag":50,"props":3400,"children":3402},{"id":3401},"troubleshooting",[3403],{"type":47,"value":3404},"Troubleshooting",{"type":41,"tag":162,"props":3406,"children":3407},{},[3408,3410,3416,3418,3426],{"type":47,"value":3409},"The common-error quick reference, the full symptom → cause → fix table, the\nunexpanded-",{"type":41,"tag":96,"props":3411,"children":3413},{"className":3412},[],[3414],{"type":47,"value":3415},"${...}",{"type":47,"value":3417}," diagnostic, and the NIM endpoint probes are consolidated in\n",{"type":41,"tag":215,"props":3419,"children":3420},{"href":2350},[3421],{"type":41,"tag":96,"props":3422,"children":3424},{"className":3423},[],[3425],{"type":47,"value":2350},{"type":47,"value":3427}," — start there\nfor any deploy, runtime, or probe failure, then continue in the matching\nper-profile reference's Debugging section.",{"type":41,"tag":3429,"props":3430,"children":3431},"style",{},[3432],{"type":47,"value":3433},"html .light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html.light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"items":3435,"total":3590},[3436,3453,3469,3480,3492,3505,3518,3532,3545,3556,3570,3579],{"slug":3437,"name":3437,"fn":3438,"description":3439,"org":3440,"tags":3441,"stars":3450,"repoUrl":3451,"updatedAt":3452},"nemoclaw-user-guide","retrieve NemoClaw documentation and configuration","Guides human users' AI agents to the NemoClaw docs MCP server and canonical Fern documentation in Markdown form. Use when users ask how to install, configure, operate, troubleshoot, secure, or learn NemoClaw with an AI coding assistant. Trigger keywords - nemoclaw docs, use nemoclaw with ai agent, nemoclaw mcp docs, nemoclaw install help, nemoclaw quickstart, nemoclaw markdown docs, llms.txt, agent skills.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3442,3445,3448],{"name":3443,"slug":3444,"type":15},"Documentation","documentation",{"name":3446,"slug":3447,"type":15},"MCP","mcp",{"name":3449,"slug":298,"type":15},"Search",21777,"https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FNemoClaw","2026-07-20T06:00:01.461044",{"slug":3454,"name":3454,"fn":3455,"description":3456,"org":3457,"tags":3458,"stars":3466,"repoUrl":3467,"updatedAt":3468},"mcore-build-and-dependency","manage Megatron-LM development environments","Container-based dev environment setup and dependency management for Megatron-LM. Covers acquiring and launching the CI container, uv package management, and updating uv.lock.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3459,3462,3463],{"name":3460,"slug":3461,"type":15},"Containers","containers",{"name":17,"slug":18,"type":15},{"name":3464,"slug":3465,"type":15},"Python","python",17049,"https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FMegatron-LM","2026-07-27T06:06:11.249662",{"slug":3470,"name":3470,"fn":3471,"description":3472,"org":3473,"tags":3474,"stars":3466,"repoUrl":3467,"updatedAt":3479},"mcore-bump-base-image","update NVIDIA PyTorch base images","Bump the NVIDIA PyTorch base image (`nvcr.io\u002Fnvidia\u002Fpytorch:YY.MM-py3`) used by Megatron-LM CI. Covers the two pin sites (GitHub CI in `docker\u002F.ngc_version.dev` and GitLab CI in `.gitlab\u002Fstages\u002F01.build.yml`), the post-bump CI loop (re-run functional tests, refresh golden values, mark broken tests), and the gotchas that bit PRs",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3475,3478],{"name":3476,"slug":3477,"type":15},"CI\u002FCD","ci-cd",{"name":17,"slug":18,"type":15},"2026-07-14T05:25:59.97109",{"slug":3481,"name":3481,"fn":3482,"description":3483,"org":3484,"tags":3485,"stars":3466,"repoUrl":3467,"updatedAt":3491},"mcore-cicd","manage CI\u002FCD pipelines for Megatron-LM","CI\u002FCD reference for Megatron-LM. Covers CI pipeline structure, PR scope labels, triggering internal GitLab CI (which force-pushes the current branch to a pull-request\u002FBRANCH ref — always dry-run and verify the destination first; never run against shared or protected branches), and CI failure investigation.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3486,3487,3488],{"name":3476,"slug":3477,"type":15},{"name":17,"slug":18,"type":15},{"name":3489,"slug":3490,"type":15},"GitHub","github","2026-07-27T06:06:12.278222",{"slug":3493,"name":3493,"fn":3494,"description":3495,"org":3496,"tags":3497,"stars":3466,"repoUrl":3467,"updatedAt":3504},"mcore-create-issue","investigate CI failures and create issues","Investigate a failing GitHub Actions run or job and create a GitHub issue for the failure.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3498,3500,3501],{"name":3159,"slug":3499,"type":15},"debugging",{"name":3489,"slug":3490,"type":15},{"name":3502,"slug":3503,"type":15},"Triage","triage","2026-07-14T05:25:57.442089",{"slug":3506,"name":3506,"fn":3507,"description":3508,"org":3509,"tags":3510,"stars":3466,"repoUrl":3467,"updatedAt":3517},"mcore-linting-and-formatting","lint and format Megatron-LM code","Linting and formatting for Megatron-LM. Covers running autoformat.sh, tools (ruff, black, isort, pylint, mypy), and code style rules.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3511,3514],{"name":3512,"slug":3513,"type":15},"Best Practices","best-practices",{"name":3515,"slug":3516,"type":15},"Code Analysis","code-analysis","2026-07-14T05:25:56.18433",{"slug":3519,"name":3519,"fn":3520,"description":3521,"org":3522,"tags":3523,"stars":3466,"repoUrl":3467,"updatedAt":3531},"mcore-migrate-gpt-to-hybrid","migrate Megatron-LM models to HybridModel","Migration guide for moving Megatron Core GPTModel checkpoints, model providers, training commands, and layer mappings to HybridModel.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3524,3527,3530],{"name":3525,"slug":3526,"type":15},"Machine Learning","machine-learning",{"name":3528,"slug":3529,"type":15},"Migration","migration",{"name":9,"slug":8,"type":15},"2026-07-17T06:07:11.777011",{"slug":3533,"name":3533,"fn":3534,"description":3535,"org":3536,"tags":3537,"stars":3466,"repoUrl":3467,"updatedAt":3544},"mcore-onboard-gb200-1node-tests","onboard functional tests for GB200","Onboard 1-node GitHub MR functional tests for GB200 from existing mr-scoped 2-node tests.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3538,3541],{"name":3539,"slug":3540,"type":15},"QA","qa",{"name":3542,"slug":3543,"type":15},"Testing","testing","2026-07-14T05:25:53.673039",{"slug":3546,"name":3546,"fn":3547,"description":3548,"org":3549,"tags":3550,"stars":3466,"repoUrl":3467,"updatedAt":3555},"mcore-run-on-slurm","launch distributed training jobs on SLURM","How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3551,3552],{"name":17,"slug":18,"type":15},{"name":3553,"slug":3554,"type":15},"Infrastructure","infrastructure","2026-07-14T05:25:49.362534",{"slug":3557,"name":3557,"fn":3558,"description":3559,"org":3560,"tags":3561,"stars":3466,"repoUrl":3467,"updatedAt":3569},"mcore-split-pr","split pull requests to reduce review load","Split a PR into multiple PRs to reduce the number of required CODEOWNERS reviewer groups.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3562,3565,3566],{"name":3563,"slug":3564,"type":15},"Code Review","code-review",{"name":3489,"slug":3490,"type":15},{"name":3567,"slug":3568,"type":15},"Pull Requests","pull-requests","2026-07-14T05:26:01.226578",{"slug":3571,"name":3571,"fn":3572,"description":3573,"org":3574,"tags":3575,"stars":3466,"repoUrl":3467,"updatedAt":3578},"mcore-testing","run and manage Megatron-LM tests","Test system for Megatron-LM. Covers test layout, recipe YAML structure, adding and running unit and functional tests, golden values, marker filters, and CI parity.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3576,3577],{"name":3539,"slug":3540,"type":15},{"name":3542,"slug":3543,"type":15},"2026-07-14T05:25:54.928983",{"slug":3580,"name":3580,"fn":3581,"description":3582,"org":3583,"tags":3584,"stars":3466,"repoUrl":3467,"updatedAt":3589},"nightly-sync","manage nightly main-to-dev sync workflows","Domain knowledge for the nightly main-to-dev sync workflow. Covers merge strategy, CI architecture, failure investigation, and known issues.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3585,3588],{"name":3586,"slug":3587,"type":15},"Automation","automation",{"name":3476,"slug":3477,"type":15},"2026-07-30T05:29:03.275638",496,{"items":3592,"total":3687},[3593,3610,3620,3634,3644,3659,3673],{"slug":3594,"name":3594,"fn":3595,"description":3596,"org":3597,"tags":3598,"stars":20,"repoUrl":21,"updatedAt":3609},"accelerated-computing-cudf","accelerate data processing with cuDF","Official NVIDIA-authored guidance for NVIDIA cuDF GPU DataFrames, pandas acceleration, dask-cuDF, ETL, joins, groupby, CSV\u002FParquet I\u002FO, nullable semantics, and multi-GPU DataFrame workloads.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3599,3602,3605,3606],{"name":3600,"slug":3601,"type":15},"Data Analysis","data-analysis",{"name":3603,"slug":3604,"type":15},"Data Engineering","data-engineering",{"name":9,"slug":8,"type":15},{"name":3607,"slug":3608,"type":15},"Performance","performance","2026-07-14T05:28:43.176466",{"slug":3611,"name":3611,"fn":3612,"description":3613,"org":3614,"tags":3615,"stars":20,"repoUrl":21,"updatedAt":3619},"aiq-deploy","deploy and manage NVIDIA AI-Q infrastructure","Use when asked to install, deploy, run, validate, troubleshoot, or stop NVIDIA AI-Q Blueprint infrastructure.\n",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3616,3617,3618],{"name":17,"slug":18,"type":15},{"name":3553,"slug":3554,"type":15},{"name":9,"slug":8,"type":15},"2026-07-14T05:29:06.667109",{"slug":3621,"name":3621,"fn":3622,"description":3623,"org":3624,"tags":3625,"stars":20,"repoUrl":21,"updatedAt":3633},"aiq-research","conduct deep research with AI-Q","Use when asked to run deep research or AI-Q research through a reachable NVIDIA AI-Q Blueprint backend.\n",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3626,3629,3630],{"name":3627,"slug":3628,"type":15},"Agents","agents",{"name":9,"slug":8,"type":15},{"name":3631,"slug":3632,"type":15},"Research","research","2026-07-14T05:28:06.816956",{"slug":3635,"name":3635,"fn":3636,"description":3637,"org":3638,"tags":3639,"stars":20,"repoUrl":21,"updatedAt":3643},"amc-run-sample-calibration","run AMC sample dataset calibration","Run end-to-end calibration on the shipped sample dataset (sdg_08_2_sample_data_010926.zip) against a running AMC microservice. Use when user says 'test sample dataset', 'run sample calibration', 'verify AMC install', or 'launch and test'.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3640,3641,3642],{"name":3600,"slug":3601,"type":15},{"name":9,"slug":8,"type":15},{"name":3542,"slug":3543,"type":15},"2026-07-17T05:29:03.913266",{"slug":3645,"name":3645,"fn":3646,"description":3647,"org":3648,"tags":3649,"stars":20,"repoUrl":21,"updatedAt":3658},"amc-run-video-calibration","calibrate video datasets with AutoMagicCalib","Calibrate a new dataset from pre-recorded video files via the AutoMagicCalib REST API. Use when user has local MP4s and says 'calibrate my videos', 'run AMC on these videos', or similar. For RTSP\u002Flive streams, use amc-run-rtsp-calibration instead.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3650,3651,3654,3655],{"name":3586,"slug":3587,"type":15},{"name":3652,"slug":3653,"type":15},"Imaging","imaging",{"name":9,"slug":8,"type":15},{"name":3656,"slug":3657,"type":15},"Video","video","2026-07-17T05:28:53.905004",{"slug":3660,"name":3660,"fn":3661,"description":3662,"org":3663,"tags":3664,"stars":20,"repoUrl":21,"updatedAt":3672},"amc-setup-calibration-stack","deploy AutoMagicCalib microservice with Docker","Launch AutoMagicCalib microservice and web UI from NGC release images via Docker Compose. Use when user says 'deploy auto calibration', 'launch auto calibration', 'launch AMC', 'start MS+UI', or 'set up auto-magic-calib'. Requires NGC API key.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3665,3666,3668,3669],{"name":17,"slug":18,"type":15},{"name":3667,"slug":932,"type":15},"Docker",{"name":9,"slug":8,"type":15},{"name":3670,"slug":3671,"type":15},"Operations","operations","2026-07-17T05:28:56.913999",{"slug":3674,"name":3674,"fn":3675,"description":3676,"org":3677,"tags":3678,"stars":20,"repoUrl":21,"updatedAt":3686},"cudaq-guide","develop quantum applications with CUDA-Q","CUDA-Q onboarding guide for installation, test programs, GPU simulation, QPU hardware, and quantum applications.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":9},[3679,3680,3683],{"name":9,"slug":8,"type":15},{"name":3681,"slug":3682,"type":15},"Quantum Computing","quantum-computing",{"name":3684,"slug":3685,"type":15},"Simulation","simulation","2026-07-14T05:26:58.898253",305]