[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill-astronomer-configuring-airflow-language-sdks":3,"mdc-blhfj6-key":55,"related-org-astronomer-configuring-airflow-language-sdks":1540,"related-repo-astronomer-configuring-airflow-language-sdks":1702},{"slug":4,"name":4,"fn":5,"description":6,"org":7,"tags":11,"stars":25,"repoUrl":26,"updatedAt":27,"license":28,"forks":29,"topics":30,"repo":50,"sourceUrl":53,"mdContent":54},"configuring-airflow-language-sdks","configure Airflow language SDKs","Configures Airflow to run language SDK tasks (Java, Go, and future native SDKs) — register a coordinator, map a queue to it, ensure the runtime\u002Fartifact on workers, and tune coordinator options. Use when the user wants Airflow to route a queue to a native-language coordinator, asks about the `[sdk]` `coordinators`\u002F`queue_to_coordinator` settings, `AIRFLOW__SDK__COORDINATORS`, `jars_root`, `executables_root` or other coordinator `kwargs`, `task_startup_timeout`, or why their native tasks aren't being picked up. Covers the shared routing mechanism plus per-coordinator options (e.g. JavaCoordinator, ExecutableCoordinator).",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},"astronomer","Astronomer","https:\u002F\u002Fpexgzepcugksgbtrxkhf.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Forg-logos\u002Fastronomer.png",[12,16,19,22],{"name":13,"slug":14,"type":15},"Configuration","configuration","tag",{"name":17,"slug":18,"type":15},"Airflow","airflow",{"name":20,"slug":21,"type":15},"Data Pipeline","data-pipeline",{"name":23,"slug":24,"type":15},"Engineering","engineering",412,"https:\u002F\u002Fgithub.com\u002Fastronomer\u002Fagents","2026-07-18T05:11:53.49561",null,55,[31,32,33,34,18,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49],"agentic-workflow","agents","ai","ai-agents","apache-airflow","claude","cursor","dag","data-engineering","data-pipelines","dbt","llm","mcp","orchestrator","skills","workflow-automation","workflow-management","workflow-orchestration","workflows",{"repoUrl":26,"stars":25,"forks":29,"topics":51,"description":52},[31,32,33,34,18,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49],"AI agent tooling for data engineering workflows.","https:\u002F\u002Fgithub.com\u002Fastronomer\u002Fagents\u002Ftree\u002FHEAD\u002Fskills\u002Fconfiguring-airflow-language-sdks","---\nname: configuring-airflow-language-sdks\ndescription: Configures Airflow to run language SDK tasks (Java, Go, and future native SDKs) — register a coordinator, map a queue to it, ensure the runtime\u002Fartifact on workers, and tune coordinator options. Use when the user wants Airflow to route a queue to a native-language coordinator, asks about the `[sdk]` `coordinators`\u002F`queue_to_coordinator` settings, `AIRFLOW__SDK__COORDINATORS`, `jars_root`, `executables_root` or other coordinator `kwargs`, `task_startup_timeout`, or why their native tasks aren't being picked up. Covers the shared routing mechanism plus per-coordinator options (e.g. JavaCoordinator, ExecutableCoordinator).\n---\n\n# Configuring Airflow for Language SDKs\n\nTo run language SDK tasks, Airflow needs to know two things: which **coordinator** launches the native subprocess, and which **queue** routes to that coordinator. The mechanism is identical across every language SDK — only each coordinator's `classpath` and `kwargs` differ. This skill documents the shared wiring once, then the per-coordinator options. It is platform-neutral: the same settings apply on open-source Airflow and on managed platforms like Astro.\n\n> **Experimental.** The language SDKs are in preview; configuration keys may change.\n\n> For the task code, see **authoring-language-sdk-tasks** (and the per-language authoring skill, e.g. **authoring-java-sdk-tasks**, **authoring-go-sdk-tasks**). For building and shipping the artifact, see the per-language deploy skill (e.g. **deploying-java-sdk-bundles**, **deploying-go-sdk-bundles**).\n\n---\n\n## Prerequisites on the worker\n\n- The **runtime or artifact the SDK needs** must be present on the worker nodes, because the coordinator spawns a native subprocess per task instance. The exact requirement is per-SDK — see [Per-coordinator options](#per-coordinator-options) (the Java SDK needs a **JRE 17+**; the Go SDK needs no language runtime — the bundle is a self-contained native executable, but it must be built for the worker's OS\u002Farch).\n- The compiled\u002Fnative **artifact(s)** must be reachable on the worker. See the per-language deploy skill.\n- The coordinators ship with the Airflow Task SDK (`apache-airflow-task-sdk`, installed with Airflow). **No extra Python package is required.**\n\n---\n\n## The two settings\n\nBoth live in the `[sdk]` configuration section and apply to every language SDK:\n\n1. **`coordinators`** — a JSON object mapping a coordinator *name* you choose to its implementation (`classpath`) and constructor `kwargs`.\n2. **`queue_to_coordinator`** — a JSON object mapping a task *queue* to a coordinator name.\n\nA task whose stub sets `queue=\"...\"` is handed to the named coordinator, which launches the native subprocess. The coordinator name is arbitrary — it just has to be the same string in both settings. The queue name must match the `queue=` set on the Python `@task.stub`.\n\n### Option A: `airflow.cfg`\n\n```ini\n[sdk]\ncoordinators = {\n  \"java-jdk17\": {\n    \"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\",\n    \"kwargs\": {\"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"]}\n  },\n  \"go\": {\n    \"classpath\": \"airflow.sdk.coordinators.executable.ExecutableCoordinator\",\n    \"kwargs\": {\"executables_root\": [\"\u002Fopt\u002Fairflow\u002Fexecutable-bundles\"]}\n  }\n}\nqueue_to_coordinator = {\"java\": \"java-jdk17\", \"golang\": \"go\"}\n```\n\n### Option B: environment variables\n\nEach value must be **valid one-line JSON**. This form is convenient for containers, `.env` files, Docker Compose, and Helm.\n\n```bash\nexport AIRFLOW__SDK__COORDINATORS='{\"java-jdk17\": {\"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\", \"kwargs\": {\"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"]}}, \"go\": {\"classpath\": \"airflow.sdk.coordinators.executable.ExecutableCoordinator\", \"kwargs\": {\"executables_root\": [\"\u002Fopt\u002Fairflow\u002Fexecutable-bundles\"]}}}'\nexport AIRFLOW__SDK__QUEUE_TO_COORDINATOR='{\"java\": \"java-jdk17\", \"golang\": \"go\"}'\n```\n\nThe examples above register **multiple coordinators** at once (one per language) and map a different queue to each — register only the ones you use.\n\n---\n\n## Per-coordinator options\n\nThe `classpath` and `kwargs` are specific to each coordinator. Add a subsection here as new language SDKs land.\n\n### JavaCoordinator\n\n- **`classpath`**: `airflow.sdk.coordinators.java.JavaCoordinator`\n- **Worker runtime**: JRE 17+ (`java` on `PATH`, or set `java_executable`).\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `jars_root` | *(required)* | One or more directories scanned **recursively** for `.jar` files. Accepts a string or a list of strings\u002Fpaths. The classpath is assembled automatically. |\n| `java_executable` | `\"java\"` | Path to the `java` binary. Defaults to `java` on `$PATH`. |\n| `jvm_args` | `[]` | Extra JVM arguments, e.g. `[\"-Xmx1g\", \"-Dsome.property=value\"]`. |\n| `main_class` | *(auto-detect)* | Explicit entry-point class. If omitted, the coordinator scans `jars_root` for a JAR whose manifest declares `Main-Class`. **Set this explicitly if multiple executable JARs are present** — otherwise the choice is non-deterministic. |\n| `task_startup_timeout` | `10.0` | Seconds to wait for the subprocess to connect after launch. Increase it if JVM startup is slow (constrained hardware, large classpath, first cold start). |\n\n**Java logging via `java.util.logging`.** Of the SDK logging integrations, only JPL and SLF4J are zero-config build dependencies; Log4j 2 and JUL need extra setup — see the logging integration section in **deploying-java-sdk-bundles**. JUL's documented alternative to calling `AirflowJulHandler.setup()` in `main()` is a `logging.properties` file, wired through `jvm_args`:\n\n```ini\n[sdk]\ncoordinators = {\n  \"java-jdk17\": {\n    \"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\",\n    \"kwargs\": {\n      \"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"],\n      \"jvm_args\": [\"-Djava.util.logging.config.file=\u002Fopt\u002Fairflow\u002Flogging.properties\"]\n    }\n  }\n}\n```\n\n### ExecutableCoordinator (Go and other self-contained-executable SDKs)\n\n- **`classpath`**: `airflow.sdk.coordinators.executable.ExecutableCoordinator`\n- **Worker runtime**: none beyond the bundle itself. The bundle is a self-contained native executable (AFBNDL01), so it needs no language runtime, but it must be built for the worker's OS\u002Farch (a mismatch fails with `exec format error`).\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `executables_root` | *(required)* | One or more directories scanned **recursively** for executable bundles (AFBNDL01-trailered native binaries). Accepts a string or a list of strings\u002Fpaths. Bundles are identified by the trailer magic, not by filename. The coordinator matches an incoming `dag_id` against each bundle's embedded manifest and verifies its integrity hash before launching. |\n| `task_startup_timeout` | `10.0` | Seconds to wait for the subprocess to connect after launch. Increase it if bundle startup is slow (constrained hardware, first cold start). |\n\n*(Future coordinators — for other languages — will list their own `classpath`, runtime, and `kwargs` here.)*\n\n---\n\n## Verifying the configuration\n\n1. Confirm the runtime\u002Fartifact is usable where workers run — for the Java SDK, `java -version` via `astro dev bash` or `docker compose exec ...`; for the Go SDK, the packed bundle exists and matches the worker's OS\u002Farch.\n2. Confirm the artifact directory referenced in `kwargs` (e.g. `jars_root`, `executables_root`) actually contains your artifact on the worker filesystem.\n3. Trigger the DAG and open the native task's logs — you should see the subprocess start and your task output.\n\n### Troubleshooting\n\n| Symptom | Likely cause \u002F fix |\n|---------|--------------------|\n| Task fails immediately mentioning coordinator or queue | `coordinators` \u002F `queue_to_coordinator` not valid one-line JSON, or the queue name doesn't match the stub's `queue=`. Fix the JSON and restart. |\n| Runtime not found (e.g. `java: command not found`) | The language runtime isn't on the worker, or the executable path kwarg is wrong. Install the runtime and verify its version. |\n| \"No artifact found\" \u002F \"no DAGs\" \u002F \"no bundle contains dag_id\" | The artifact-directory kwarg points at the wrong place, the artifact isn't there yet, or its `dag_id` doesn't match the stub. Confirm the path and the IDs. |\n| Wrong\u002Fambiguous entry point (Java) | Multiple executable JARs under `jars_root`. Set `main_class` explicitly. |\n| Go bundle is skipped silently | Not a valid AFBNDL01 bundle, or its integrity hash failed (re-pack after any strip\u002Fsign\u002Frebuild). |\n| `exec format error` on the Go bundle | Built for a different OS\u002Farch than the worker. Cross-compile with `--goos`\u002F`--goarch` (see **deploying-go-sdk-bundles**). |\n| DAG run hangs at the native task | Raise `task_startup_timeout` (e.g. `30.0`); first-run subprocess startup can be slow. |\n\n---\n\n## Related Skills\n\n- **authoring-language-sdk-tasks**: The shared Python-stub pattern and conceptual model.\n- **authoring-java-sdk-tasks**: Java task code and matching Python stubs.\n- **deploying-java-sdk-bundles**: Build the bundle and put the artifact where the coordinator scans.\n- **authoring-go-sdk-tasks**: Go task code and matching Python stubs.\n- **deploying-go-sdk-bundles**: Build\u002Fpack the Go bundle and place it where the coordinator scans.\n- **deploying-airflow**: General deployment of Airflow on Astro, Docker Compose, or Kubernetes.\n",{"data":56,"body":57},{"name":4,"description":6},{"type":58,"children":59},"root",[60,69,107,121,163,167,174,237,240,246,259,319,347,360,481,487,507,582,594,597,602,619,625,680,904,958,1039,1045,1082,1167,1189,1192,1198,1260,1266,1467,1470,1476,1534],{"type":61,"tag":62,"props":63,"children":65},"element","h1",{"id":64},"configuring-airflow-for-language-sdks",[66],{"type":67,"value":68},"text","Configuring Airflow for Language SDKs",{"type":61,"tag":70,"props":71,"children":72},"p",{},[73,75,81,83,88,90,97,99,105],{"type":67,"value":74},"To run language SDK tasks, Airflow needs to know two things: which ",{"type":61,"tag":76,"props":77,"children":78},"strong",{},[79],{"type":67,"value":80},"coordinator",{"type":67,"value":82}," launches the native subprocess, and which ",{"type":61,"tag":76,"props":84,"children":85},{},[86],{"type":67,"value":87},"queue",{"type":67,"value":89}," routes to that coordinator. The mechanism is identical across every language SDK — only each coordinator's ",{"type":61,"tag":91,"props":92,"children":94},"code",{"className":93},[],[95],{"type":67,"value":96},"classpath",{"type":67,"value":98}," and ",{"type":61,"tag":91,"props":100,"children":102},{"className":101},[],[103],{"type":67,"value":104},"kwargs",{"type":67,"value":106}," differ. This skill documents the shared wiring once, then the per-coordinator options. It is platform-neutral: the same settings apply on open-source Airflow and on managed platforms like Astro.",{"type":61,"tag":108,"props":109,"children":110},"blockquote",{},[111],{"type":61,"tag":70,"props":112,"children":113},{},[114,119],{"type":61,"tag":76,"props":115,"children":116},{},[117],{"type":67,"value":118},"Experimental.",{"type":67,"value":120}," The language SDKs are in preview; configuration keys may change.",{"type":61,"tag":108,"props":122,"children":123},{},[124],{"type":61,"tag":70,"props":125,"children":126},{},[127,129,134,136,141,143,148,150,155,156,161],{"type":67,"value":128},"For the task code, see ",{"type":61,"tag":76,"props":130,"children":131},{},[132],{"type":67,"value":133},"authoring-language-sdk-tasks",{"type":67,"value":135}," (and the per-language authoring skill, e.g. ",{"type":61,"tag":76,"props":137,"children":138},{},[139],{"type":67,"value":140},"authoring-java-sdk-tasks",{"type":67,"value":142},", ",{"type":61,"tag":76,"props":144,"children":145},{},[146],{"type":67,"value":147},"authoring-go-sdk-tasks",{"type":67,"value":149},"). For building and shipping the artifact, see the per-language deploy skill (e.g. ",{"type":61,"tag":76,"props":151,"children":152},{},[153],{"type":67,"value":154},"deploying-java-sdk-bundles",{"type":67,"value":142},{"type":61,"tag":76,"props":157,"children":158},{},[159],{"type":67,"value":160},"deploying-go-sdk-bundles",{"type":67,"value":162},").",{"type":61,"tag":164,"props":165,"children":166},"hr",{},[],{"type":61,"tag":168,"props":169,"children":171},"h2",{"id":170},"prerequisites-on-the-worker",[172],{"type":67,"value":173},"Prerequisites on the worker",{"type":61,"tag":175,"props":176,"children":177},"ul",{},[178,207,219],{"type":61,"tag":179,"props":180,"children":181},"li",{},[182,184,189,191,198,200,205],{"type":67,"value":183},"The ",{"type":61,"tag":76,"props":185,"children":186},{},[187],{"type":67,"value":188},"runtime or artifact the SDK needs",{"type":67,"value":190}," must be present on the worker nodes, because the coordinator spawns a native subprocess per task instance. The exact requirement is per-SDK — see ",{"type":61,"tag":192,"props":193,"children":195},"a",{"href":194},"#per-coordinator-options",[196],{"type":67,"value":197},"Per-coordinator options",{"type":67,"value":199}," (the Java SDK needs a ",{"type":61,"tag":76,"props":201,"children":202},{},[203],{"type":67,"value":204},"JRE 17+",{"type":67,"value":206},"; the Go SDK needs no language runtime — the bundle is a self-contained native executable, but it must be built for the worker's OS\u002Farch).",{"type":61,"tag":179,"props":208,"children":209},{},[210,212,217],{"type":67,"value":211},"The compiled\u002Fnative ",{"type":61,"tag":76,"props":213,"children":214},{},[215],{"type":67,"value":216},"artifact(s)",{"type":67,"value":218}," must be reachable on the worker. See the per-language deploy skill.",{"type":61,"tag":179,"props":220,"children":221},{},[222,224,230,232],{"type":67,"value":223},"The coordinators ship with the Airflow Task SDK (",{"type":61,"tag":91,"props":225,"children":227},{"className":226},[],[228],{"type":67,"value":229},"apache-airflow-task-sdk",{"type":67,"value":231},", installed with Airflow). ",{"type":61,"tag":76,"props":233,"children":234},{},[235],{"type":67,"value":236},"No extra Python package is required.",{"type":61,"tag":164,"props":238,"children":239},{},[],{"type":61,"tag":168,"props":241,"children":243},{"id":242},"the-two-settings",[244],{"type":67,"value":245},"The two settings",{"type":61,"tag":70,"props":247,"children":248},{},[249,251,257],{"type":67,"value":250},"Both live in the ",{"type":61,"tag":91,"props":252,"children":254},{"className":253},[],[255],{"type":67,"value":256},"[sdk]",{"type":67,"value":258}," configuration section and apply to every language SDK:",{"type":61,"tag":260,"props":261,"children":262},"ol",{},[263,299],{"type":61,"tag":179,"props":264,"children":265},{},[266,275,277,283,285,290,292,297],{"type":61,"tag":76,"props":267,"children":268},{},[269],{"type":61,"tag":91,"props":270,"children":272},{"className":271},[],[273],{"type":67,"value":274},"coordinators",{"type":67,"value":276}," — a JSON object mapping a coordinator ",{"type":61,"tag":278,"props":279,"children":280},"em",{},[281],{"type":67,"value":282},"name",{"type":67,"value":284}," you choose to its implementation (",{"type":61,"tag":91,"props":286,"children":288},{"className":287},[],[289],{"type":67,"value":96},{"type":67,"value":291},") and constructor ",{"type":61,"tag":91,"props":293,"children":295},{"className":294},[],[296],{"type":67,"value":104},{"type":67,"value":298},".",{"type":61,"tag":179,"props":300,"children":301},{},[302,311,313,317],{"type":61,"tag":76,"props":303,"children":304},{},[305],{"type":61,"tag":91,"props":306,"children":308},{"className":307},[],[309],{"type":67,"value":310},"queue_to_coordinator",{"type":67,"value":312}," — a JSON object mapping a task ",{"type":61,"tag":278,"props":314,"children":315},{},[316],{"type":67,"value":87},{"type":67,"value":318}," to a coordinator name.",{"type":61,"tag":70,"props":320,"children":321},{},[322,324,330,332,338,340,346],{"type":67,"value":323},"A task whose stub sets ",{"type":61,"tag":91,"props":325,"children":327},{"className":326},[],[328],{"type":67,"value":329},"queue=\"...\"",{"type":67,"value":331}," is handed to the named coordinator, which launches the native subprocess. The coordinator name is arbitrary — it just has to be the same string in both settings. The queue name must match the ",{"type":61,"tag":91,"props":333,"children":335},{"className":334},[],[336],{"type":67,"value":337},"queue=",{"type":67,"value":339}," set on the Python ",{"type":61,"tag":91,"props":341,"children":343},{"className":342},[],[344],{"type":67,"value":345},"@task.stub",{"type":67,"value":298},{"type":61,"tag":348,"props":349,"children":351},"h3",{"id":350},"option-a-airflowcfg",[352,354],{"type":67,"value":353},"Option A: ",{"type":61,"tag":91,"props":355,"children":357},{"className":356},[],[358],{"type":67,"value":359},"airflow.cfg",{"type":61,"tag":361,"props":362,"children":367},"pre",{"className":363,"code":364,"language":365,"meta":366,"style":366},"language-ini shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","[sdk]\ncoordinators = {\n  \"java-jdk17\": {\n    \"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\",\n    \"kwargs\": {\"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"]}\n  },\n  \"go\": {\n    \"classpath\": \"airflow.sdk.coordinators.executable.ExecutableCoordinator\",\n    \"kwargs\": {\"executables_root\": [\"\u002Fopt\u002Fairflow\u002Fexecutable-bundles\"]}\n  }\n}\nqueue_to_coordinator = {\"java\": \"java-jdk17\", \"golang\": \"go\"}\n","ini","",[368],{"type":61,"tag":91,"props":369,"children":370},{"__ignoreMap":366},[371,382,391,400,409,418,427,436,445,454,463,472],{"type":61,"tag":372,"props":373,"children":376},"span",{"class":374,"line":375},"line",1,[377],{"type":61,"tag":372,"props":378,"children":379},{},[380],{"type":67,"value":381},"[sdk]\n",{"type":61,"tag":372,"props":383,"children":385},{"class":374,"line":384},2,[386],{"type":61,"tag":372,"props":387,"children":388},{},[389],{"type":67,"value":390},"coordinators = {\n",{"type":61,"tag":372,"props":392,"children":394},{"class":374,"line":393},3,[395],{"type":61,"tag":372,"props":396,"children":397},{},[398],{"type":67,"value":399},"  \"java-jdk17\": {\n",{"type":61,"tag":372,"props":401,"children":403},{"class":374,"line":402},4,[404],{"type":61,"tag":372,"props":405,"children":406},{},[407],{"type":67,"value":408},"    \"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\",\n",{"type":61,"tag":372,"props":410,"children":412},{"class":374,"line":411},5,[413],{"type":61,"tag":372,"props":414,"children":415},{},[416],{"type":67,"value":417},"    \"kwargs\": {\"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"]}\n",{"type":61,"tag":372,"props":419,"children":421},{"class":374,"line":420},6,[422],{"type":61,"tag":372,"props":423,"children":424},{},[425],{"type":67,"value":426},"  },\n",{"type":61,"tag":372,"props":428,"children":430},{"class":374,"line":429},7,[431],{"type":61,"tag":372,"props":432,"children":433},{},[434],{"type":67,"value":435},"  \"go\": {\n",{"type":61,"tag":372,"props":437,"children":439},{"class":374,"line":438},8,[440],{"type":61,"tag":372,"props":441,"children":442},{},[443],{"type":67,"value":444},"    \"classpath\": \"airflow.sdk.coordinators.executable.ExecutableCoordinator\",\n",{"type":61,"tag":372,"props":446,"children":448},{"class":374,"line":447},9,[449],{"type":61,"tag":372,"props":450,"children":451},{},[452],{"type":67,"value":453},"    \"kwargs\": {\"executables_root\": [\"\u002Fopt\u002Fairflow\u002Fexecutable-bundles\"]}\n",{"type":61,"tag":372,"props":455,"children":457},{"class":374,"line":456},10,[458],{"type":61,"tag":372,"props":459,"children":460},{},[461],{"type":67,"value":462},"  }\n",{"type":61,"tag":372,"props":464,"children":466},{"class":374,"line":465},11,[467],{"type":61,"tag":372,"props":468,"children":469},{},[470],{"type":67,"value":471},"}\n",{"type":61,"tag":372,"props":473,"children":475},{"class":374,"line":474},12,[476],{"type":61,"tag":372,"props":477,"children":478},{},[479],{"type":67,"value":480},"queue_to_coordinator = {\"java\": \"java-jdk17\", \"golang\": \"go\"}\n",{"type":61,"tag":348,"props":482,"children":484},{"id":483},"option-b-environment-variables",[485],{"type":67,"value":486},"Option B: environment variables",{"type":61,"tag":70,"props":488,"children":489},{},[490,492,497,499,505],{"type":67,"value":491},"Each value must be ",{"type":61,"tag":76,"props":493,"children":494},{},[495],{"type":67,"value":496},"valid one-line JSON",{"type":67,"value":498},". This form is convenient for containers, ",{"type":61,"tag":91,"props":500,"children":502},{"className":501},[],[503],{"type":67,"value":504},".env",{"type":67,"value":506}," files, Docker Compose, and Helm.",{"type":61,"tag":361,"props":508,"children":512},{"className":509,"code":510,"language":511,"meta":366,"style":366},"language-bash shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","export AIRFLOW__SDK__COORDINATORS='{\"java-jdk17\": {\"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\", \"kwargs\": {\"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"]}}, \"go\": {\"classpath\": \"airflow.sdk.coordinators.executable.ExecutableCoordinator\", \"kwargs\": {\"executables_root\": [\"\u002Fopt\u002Fairflow\u002Fexecutable-bundles\"]}}}'\nexport AIRFLOW__SDK__QUEUE_TO_COORDINATOR='{\"java\": \"java-jdk17\", \"golang\": \"go\"}'\n","bash",[513],{"type":61,"tag":91,"props":514,"children":515},{"__ignoreMap":366},[516,553],{"type":61,"tag":372,"props":517,"children":518},{"class":374,"line":375},[519,525,531,537,542,548],{"type":61,"tag":372,"props":520,"children":522},{"style":521},"--shiki-light:#9C3EDA;--shiki-default:#C792EA;--shiki-dark:#C792EA",[523],{"type":67,"value":524},"export",{"type":61,"tag":372,"props":526,"children":528},{"style":527},"--shiki-light:#90A4AE;--shiki-default:#EEFFFF;--shiki-dark:#BABED8",[529],{"type":67,"value":530}," AIRFLOW__SDK__COORDINATORS",{"type":61,"tag":372,"props":532,"children":534},{"style":533},"--shiki-light:#39ADB5;--shiki-default:#89DDFF;--shiki-dark:#89DDFF",[535],{"type":67,"value":536},"=",{"type":61,"tag":372,"props":538,"children":539},{"style":533},[540],{"type":67,"value":541},"'",{"type":61,"tag":372,"props":543,"children":545},{"style":544},"--shiki-light:#91B859;--shiki-default:#C3E88D;--shiki-dark:#C3E88D",[546],{"type":67,"value":547},"{\"java-jdk17\": {\"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\", \"kwargs\": {\"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"]}}, \"go\": {\"classpath\": \"airflow.sdk.coordinators.executable.ExecutableCoordinator\", \"kwargs\": {\"executables_root\": [\"\u002Fopt\u002Fairflow\u002Fexecutable-bundles\"]}}}",{"type":61,"tag":372,"props":549,"children":550},{"style":533},[551],{"type":67,"value":552},"'\n",{"type":61,"tag":372,"props":554,"children":555},{"class":374,"line":384},[556,560,565,569,573,578],{"type":61,"tag":372,"props":557,"children":558},{"style":521},[559],{"type":67,"value":524},{"type":61,"tag":372,"props":561,"children":562},{"style":527},[563],{"type":67,"value":564}," AIRFLOW__SDK__QUEUE_TO_COORDINATOR",{"type":61,"tag":372,"props":566,"children":567},{"style":533},[568],{"type":67,"value":536},{"type":61,"tag":372,"props":570,"children":571},{"style":533},[572],{"type":67,"value":541},{"type":61,"tag":372,"props":574,"children":575},{"style":544},[576],{"type":67,"value":577},"{\"java\": \"java-jdk17\", \"golang\": \"go\"}",{"type":61,"tag":372,"props":579,"children":580},{"style":533},[581],{"type":67,"value":552},{"type":61,"tag":70,"props":583,"children":584},{},[585,587,592],{"type":67,"value":586},"The examples above register ",{"type":61,"tag":76,"props":588,"children":589},{},[590],{"type":67,"value":591},"multiple coordinators",{"type":67,"value":593}," at once (one per language) and map a different queue to each — register only the ones you use.",{"type":61,"tag":164,"props":595,"children":596},{},[],{"type":61,"tag":168,"props":598,"children":600},{"id":599},"per-coordinator-options",[601],{"type":67,"value":197},{"type":61,"tag":70,"props":603,"children":604},{},[605,606,611,612,617],{"type":67,"value":183},{"type":61,"tag":91,"props":607,"children":609},{"className":608},[],[610],{"type":67,"value":96},{"type":67,"value":98},{"type":61,"tag":91,"props":613,"children":615},{"className":614},[],[616],{"type":67,"value":104},{"type":67,"value":618}," are specific to each coordinator. Add a subsection here as new language SDKs land.",{"type":61,"tag":348,"props":620,"children":622},{"id":621},"javacoordinator",[623],{"type":67,"value":624},"JavaCoordinator",{"type":61,"tag":175,"props":626,"children":627},{},[628,647],{"type":61,"tag":179,"props":629,"children":630},{},[631,639,641],{"type":61,"tag":76,"props":632,"children":633},{},[634],{"type":61,"tag":91,"props":635,"children":637},{"className":636},[],[638],{"type":67,"value":96},{"type":67,"value":640},": ",{"type":61,"tag":91,"props":642,"children":644},{"className":643},[],[645],{"type":67,"value":646},"airflow.sdk.coordinators.java.JavaCoordinator",{"type":61,"tag":179,"props":648,"children":649},{},[650,655,657,663,665,671,673,679],{"type":61,"tag":76,"props":651,"children":652},{},[653],{"type":67,"value":654},"Worker runtime",{"type":67,"value":656},": JRE 17+ (",{"type":61,"tag":91,"props":658,"children":660},{"className":659},[],[661],{"type":67,"value":662},"java",{"type":67,"value":664}," on ",{"type":61,"tag":91,"props":666,"children":668},{"className":667},[],[669],{"type":67,"value":670},"PATH",{"type":67,"value":672},", or set ",{"type":61,"tag":91,"props":674,"children":676},{"className":675},[],[677],{"type":67,"value":678},"java_executable",{"type":67,"value":162},{"type":61,"tag":681,"props":682,"children":683},"table",{},[684,708],{"type":61,"tag":685,"props":686,"children":687},"thead",{},[688],{"type":61,"tag":689,"props":690,"children":691},"tr",{},[692,698,703],{"type":61,"tag":693,"props":694,"children":695},"th",{},[696],{"type":67,"value":697},"Parameter",{"type":61,"tag":693,"props":699,"children":700},{},[701],{"type":67,"value":702},"Default",{"type":61,"tag":693,"props":704,"children":705},{},[706],{"type":67,"value":707},"Description",{"type":61,"tag":709,"props":710,"children":711},"tbody",{},[712,753,798,831,878],{"type":61,"tag":689,"props":713,"children":714},{},[715,725,733],{"type":61,"tag":716,"props":717,"children":718},"td",{},[719],{"type":61,"tag":91,"props":720,"children":722},{"className":721},[],[723],{"type":67,"value":724},"jars_root",{"type":61,"tag":716,"props":726,"children":727},{},[728],{"type":61,"tag":278,"props":729,"children":730},{},[731],{"type":67,"value":732},"(required)",{"type":61,"tag":716,"props":734,"children":735},{},[736,738,743,745,751],{"type":67,"value":737},"One or more directories scanned ",{"type":61,"tag":76,"props":739,"children":740},{},[741],{"type":67,"value":742},"recursively",{"type":67,"value":744}," for ",{"type":61,"tag":91,"props":746,"children":748},{"className":747},[],[749],{"type":67,"value":750},".jar",{"type":67,"value":752}," files. Accepts a string or a list of strings\u002Fpaths. The classpath is assembled automatically.",{"type":61,"tag":689,"props":754,"children":755},{},[756,764,773],{"type":61,"tag":716,"props":757,"children":758},{},[759],{"type":61,"tag":91,"props":760,"children":762},{"className":761},[],[763],{"type":67,"value":678},{"type":61,"tag":716,"props":765,"children":766},{},[767],{"type":61,"tag":91,"props":768,"children":770},{"className":769},[],[771],{"type":67,"value":772},"\"java\"",{"type":61,"tag":716,"props":774,"children":775},{},[776,778,783,785,790,791,797],{"type":67,"value":777},"Path to the ",{"type":61,"tag":91,"props":779,"children":781},{"className":780},[],[782],{"type":67,"value":662},{"type":67,"value":784}," binary. Defaults to ",{"type":61,"tag":91,"props":786,"children":788},{"className":787},[],[789],{"type":67,"value":662},{"type":67,"value":664},{"type":61,"tag":91,"props":792,"children":794},{"className":793},[],[795],{"type":67,"value":796},"$PATH",{"type":67,"value":298},{"type":61,"tag":689,"props":799,"children":800},{},[801,810,819],{"type":61,"tag":716,"props":802,"children":803},{},[804],{"type":61,"tag":91,"props":805,"children":807},{"className":806},[],[808],{"type":67,"value":809},"jvm_args",{"type":61,"tag":716,"props":811,"children":812},{},[813],{"type":61,"tag":91,"props":814,"children":816},{"className":815},[],[817],{"type":67,"value":818},"[]",{"type":61,"tag":716,"props":820,"children":821},{},[822,824,830],{"type":67,"value":823},"Extra JVM arguments, e.g. ",{"type":61,"tag":91,"props":825,"children":827},{"className":826},[],[828],{"type":67,"value":829},"[\"-Xmx1g\", \"-Dsome.property=value\"]",{"type":67,"value":298},{"type":61,"tag":689,"props":832,"children":833},{},[834,843,851],{"type":61,"tag":716,"props":835,"children":836},{},[837],{"type":61,"tag":91,"props":838,"children":840},{"className":839},[],[841],{"type":67,"value":842},"main_class",{"type":61,"tag":716,"props":844,"children":845},{},[846],{"type":61,"tag":278,"props":847,"children":848},{},[849],{"type":67,"value":850},"(auto-detect)",{"type":61,"tag":716,"props":852,"children":853},{},[854,856,861,863,869,871,876],{"type":67,"value":855},"Explicit entry-point class. If omitted, the coordinator scans ",{"type":61,"tag":91,"props":857,"children":859},{"className":858},[],[860],{"type":67,"value":724},{"type":67,"value":862}," for a JAR whose manifest declares ",{"type":61,"tag":91,"props":864,"children":866},{"className":865},[],[867],{"type":67,"value":868},"Main-Class",{"type":67,"value":870},". ",{"type":61,"tag":76,"props":872,"children":873},{},[874],{"type":67,"value":875},"Set this explicitly if multiple executable JARs are present",{"type":67,"value":877}," — otherwise the choice is non-deterministic.",{"type":61,"tag":689,"props":879,"children":880},{},[881,890,899],{"type":61,"tag":716,"props":882,"children":883},{},[884],{"type":61,"tag":91,"props":885,"children":887},{"className":886},[],[888],{"type":67,"value":889},"task_startup_timeout",{"type":61,"tag":716,"props":891,"children":892},{},[893],{"type":61,"tag":91,"props":894,"children":896},{"className":895},[],[897],{"type":67,"value":898},"10.0",{"type":61,"tag":716,"props":900,"children":901},{},[902],{"type":67,"value":903},"Seconds to wait for the subprocess to connect after launch. Increase it if JVM startup is slow (constrained hardware, large classpath, first cold start).",{"type":61,"tag":70,"props":905,"children":906},{},[907,919,921,925,927,933,935,941,943,949,951,956],{"type":61,"tag":76,"props":908,"children":909},{},[910,912,918],{"type":67,"value":911},"Java logging via ",{"type":61,"tag":91,"props":913,"children":915},{"className":914},[],[916],{"type":67,"value":917},"java.util.logging",{"type":67,"value":298},{"type":67,"value":920}," Of the SDK logging integrations, only JPL and SLF4J are zero-config build dependencies; Log4j 2 and JUL need extra setup — see the logging integration section in ",{"type":61,"tag":76,"props":922,"children":923},{},[924],{"type":67,"value":154},{"type":67,"value":926},". JUL's documented alternative to calling ",{"type":61,"tag":91,"props":928,"children":930},{"className":929},[],[931],{"type":67,"value":932},"AirflowJulHandler.setup()",{"type":67,"value":934}," in ",{"type":61,"tag":91,"props":936,"children":938},{"className":937},[],[939],{"type":67,"value":940},"main()",{"type":67,"value":942}," is a ",{"type":61,"tag":91,"props":944,"children":946},{"className":945},[],[947],{"type":67,"value":948},"logging.properties",{"type":67,"value":950}," file, wired through ",{"type":61,"tag":91,"props":952,"children":954},{"className":953},[],[955],{"type":67,"value":809},{"type":67,"value":957},":",{"type":61,"tag":361,"props":959,"children":961},{"className":363,"code":960,"language":365,"meta":366,"style":366},"[sdk]\ncoordinators = {\n  \"java-jdk17\": {\n    \"classpath\": \"airflow.sdk.coordinators.java.JavaCoordinator\",\n    \"kwargs\": {\n      \"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"],\n      \"jvm_args\": [\"-Djava.util.logging.config.file=\u002Fopt\u002Fairflow\u002Flogging.properties\"]\n    }\n  }\n}\n",[962],{"type":61,"tag":91,"props":963,"children":964},{"__ignoreMap":366},[965,972,979,986,993,1001,1009,1017,1025,1032],{"type":61,"tag":372,"props":966,"children":967},{"class":374,"line":375},[968],{"type":61,"tag":372,"props":969,"children":970},{},[971],{"type":67,"value":381},{"type":61,"tag":372,"props":973,"children":974},{"class":374,"line":384},[975],{"type":61,"tag":372,"props":976,"children":977},{},[978],{"type":67,"value":390},{"type":61,"tag":372,"props":980,"children":981},{"class":374,"line":393},[982],{"type":61,"tag":372,"props":983,"children":984},{},[985],{"type":67,"value":399},{"type":61,"tag":372,"props":987,"children":988},{"class":374,"line":402},[989],{"type":61,"tag":372,"props":990,"children":991},{},[992],{"type":67,"value":408},{"type":61,"tag":372,"props":994,"children":995},{"class":374,"line":411},[996],{"type":61,"tag":372,"props":997,"children":998},{},[999],{"type":67,"value":1000},"    \"kwargs\": {\n",{"type":61,"tag":372,"props":1002,"children":1003},{"class":374,"line":420},[1004],{"type":61,"tag":372,"props":1005,"children":1006},{},[1007],{"type":67,"value":1008},"      \"jars_root\": [\"\u002Fopt\u002Fairflow\u002Fjars\"],\n",{"type":61,"tag":372,"props":1010,"children":1011},{"class":374,"line":429},[1012],{"type":61,"tag":372,"props":1013,"children":1014},{},[1015],{"type":67,"value":1016},"      \"jvm_args\": [\"-Djava.util.logging.config.file=\u002Fopt\u002Fairflow\u002Flogging.properties\"]\n",{"type":61,"tag":372,"props":1018,"children":1019},{"class":374,"line":438},[1020],{"type":61,"tag":372,"props":1021,"children":1022},{},[1023],{"type":67,"value":1024},"    }\n",{"type":61,"tag":372,"props":1026,"children":1027},{"class":374,"line":447},[1028],{"type":61,"tag":372,"props":1029,"children":1030},{},[1031],{"type":67,"value":462},{"type":61,"tag":372,"props":1033,"children":1034},{"class":374,"line":456},[1035],{"type":61,"tag":372,"props":1036,"children":1037},{},[1038],{"type":67,"value":471},{"type":61,"tag":348,"props":1040,"children":1042},{"id":1041},"executablecoordinator-go-and-other-self-contained-executable-sdks",[1043],{"type":67,"value":1044},"ExecutableCoordinator (Go and other self-contained-executable SDKs)",{"type":61,"tag":175,"props":1046,"children":1047},{},[1048,1066],{"type":61,"tag":179,"props":1049,"children":1050},{},[1051,1059,1060],{"type":61,"tag":76,"props":1052,"children":1053},{},[1054],{"type":61,"tag":91,"props":1055,"children":1057},{"className":1056},[],[1058],{"type":67,"value":96},{"type":67,"value":640},{"type":61,"tag":91,"props":1061,"children":1063},{"className":1062},[],[1064],{"type":67,"value":1065},"airflow.sdk.coordinators.executable.ExecutableCoordinator",{"type":61,"tag":179,"props":1067,"children":1068},{},[1069,1073,1075,1081],{"type":61,"tag":76,"props":1070,"children":1071},{},[1072],{"type":67,"value":654},{"type":67,"value":1074},": none beyond the bundle itself. The bundle is a self-contained native executable (AFBNDL01), so it needs no language runtime, but it must be built for the worker's OS\u002Farch (a mismatch fails with ",{"type":61,"tag":91,"props":1076,"children":1078},{"className":1077},[],[1079],{"type":67,"value":1080},"exec format error",{"type":67,"value":162},{"type":61,"tag":681,"props":1083,"children":1084},{},[1085,1103],{"type":61,"tag":685,"props":1086,"children":1087},{},[1088],{"type":61,"tag":689,"props":1089,"children":1090},{},[1091,1095,1099],{"type":61,"tag":693,"props":1092,"children":1093},{},[1094],{"type":67,"value":697},{"type":61,"tag":693,"props":1096,"children":1097},{},[1098],{"type":67,"value":702},{"type":61,"tag":693,"props":1100,"children":1101},{},[1102],{"type":67,"value":707},{"type":61,"tag":709,"props":1104,"children":1105},{},[1106,1143],{"type":61,"tag":689,"props":1107,"children":1108},{},[1109,1118,1125],{"type":61,"tag":716,"props":1110,"children":1111},{},[1112],{"type":61,"tag":91,"props":1113,"children":1115},{"className":1114},[],[1116],{"type":67,"value":1117},"executables_root",{"type":61,"tag":716,"props":1119,"children":1120},{},[1121],{"type":61,"tag":278,"props":1122,"children":1123},{},[1124],{"type":67,"value":732},{"type":61,"tag":716,"props":1126,"children":1127},{},[1128,1129,1133,1135,1141],{"type":67,"value":737},{"type":61,"tag":76,"props":1130,"children":1131},{},[1132],{"type":67,"value":742},{"type":67,"value":1134}," for executable bundles (AFBNDL01-trailered native binaries). Accepts a string or a list of strings\u002Fpaths. Bundles are identified by the trailer magic, not by filename. The coordinator matches an incoming ",{"type":61,"tag":91,"props":1136,"children":1138},{"className":1137},[],[1139],{"type":67,"value":1140},"dag_id",{"type":67,"value":1142}," against each bundle's embedded manifest and verifies its integrity hash before launching.",{"type":61,"tag":689,"props":1144,"children":1145},{},[1146,1154,1162],{"type":61,"tag":716,"props":1147,"children":1148},{},[1149],{"type":61,"tag":91,"props":1150,"children":1152},{"className":1151},[],[1153],{"type":67,"value":889},{"type":61,"tag":716,"props":1155,"children":1156},{},[1157],{"type":61,"tag":91,"props":1158,"children":1160},{"className":1159},[],[1161],{"type":67,"value":898},{"type":61,"tag":716,"props":1163,"children":1164},{},[1165],{"type":67,"value":1166},"Seconds to wait for the subprocess to connect after launch. Increase it if bundle startup is slow (constrained hardware, first cold start).",{"type":61,"tag":70,"props":1168,"children":1169},{},[1170],{"type":61,"tag":278,"props":1171,"children":1172},{},[1173,1175,1180,1182,1187],{"type":67,"value":1174},"(Future coordinators — for other languages — will list their own ",{"type":61,"tag":91,"props":1176,"children":1178},{"className":1177},[],[1179],{"type":67,"value":96},{"type":67,"value":1181},", runtime, and ",{"type":61,"tag":91,"props":1183,"children":1185},{"className":1184},[],[1186],{"type":67,"value":104},{"type":67,"value":1188}," here.)",{"type":61,"tag":164,"props":1190,"children":1191},{},[],{"type":61,"tag":168,"props":1193,"children":1195},{"id":1194},"verifying-the-configuration",[1196],{"type":67,"value":1197},"Verifying the configuration",{"type":61,"tag":260,"props":1199,"children":1200},{},[1201,1230,1255],{"type":61,"tag":179,"props":1202,"children":1203},{},[1204,1206,1212,1214,1220,1222,1228],{"type":67,"value":1205},"Confirm the runtime\u002Fartifact is usable where workers run — for the Java SDK, ",{"type":61,"tag":91,"props":1207,"children":1209},{"className":1208},[],[1210],{"type":67,"value":1211},"java -version",{"type":67,"value":1213}," via ",{"type":61,"tag":91,"props":1215,"children":1217},{"className":1216},[],[1218],{"type":67,"value":1219},"astro dev bash",{"type":67,"value":1221}," or ",{"type":61,"tag":91,"props":1223,"children":1225},{"className":1224},[],[1226],{"type":67,"value":1227},"docker compose exec ...",{"type":67,"value":1229},"; for the Go SDK, the packed bundle exists and matches the worker's OS\u002Farch.",{"type":61,"tag":179,"props":1231,"children":1232},{},[1233,1235,1240,1242,1247,1248,1253],{"type":67,"value":1234},"Confirm the artifact directory referenced in ",{"type":61,"tag":91,"props":1236,"children":1238},{"className":1237},[],[1239],{"type":67,"value":104},{"type":67,"value":1241}," (e.g. ",{"type":61,"tag":91,"props":1243,"children":1245},{"className":1244},[],[1246],{"type":67,"value":724},{"type":67,"value":142},{"type":61,"tag":91,"props":1249,"children":1251},{"className":1250},[],[1252],{"type":67,"value":1117},{"type":67,"value":1254},") actually contains your artifact on the worker filesystem.",{"type":61,"tag":179,"props":1256,"children":1257},{},[1258],{"type":67,"value":1259},"Trigger the DAG and open the native task's logs — you should see the subprocess start and your task output.",{"type":61,"tag":348,"props":1261,"children":1263},{"id":1262},"troubleshooting",[1264],{"type":67,"value":1265},"Troubleshooting",{"type":61,"tag":681,"props":1267,"children":1268},{},[1269,1285],{"type":61,"tag":685,"props":1270,"children":1271},{},[1272],{"type":61,"tag":689,"props":1273,"children":1274},{},[1275,1280],{"type":61,"tag":693,"props":1276,"children":1277},{},[1278],{"type":67,"value":1279},"Symptom",{"type":61,"tag":693,"props":1281,"children":1282},{},[1283],{"type":67,"value":1284},"Likely cause \u002F fix",{"type":61,"tag":709,"props":1286,"children":1287},{},[1288,1320,1341,1361,1388,1401,1440],{"type":61,"tag":689,"props":1289,"children":1290},{},[1291,1296],{"type":61,"tag":716,"props":1292,"children":1293},{},[1294],{"type":67,"value":1295},"Task fails immediately mentioning coordinator or queue",{"type":61,"tag":716,"props":1297,"children":1298},{},[1299,1304,1306,1311,1313,1318],{"type":61,"tag":91,"props":1300,"children":1302},{"className":1301},[],[1303],{"type":67,"value":274},{"type":67,"value":1305}," \u002F ",{"type":61,"tag":91,"props":1307,"children":1309},{"className":1308},[],[1310],{"type":67,"value":310},{"type":67,"value":1312}," not valid one-line JSON, or the queue name doesn't match the stub's ",{"type":61,"tag":91,"props":1314,"children":1316},{"className":1315},[],[1317],{"type":67,"value":337},{"type":67,"value":1319},". Fix the JSON and restart.",{"type":61,"tag":689,"props":1321,"children":1322},{},[1323,1336],{"type":61,"tag":716,"props":1324,"children":1325},{},[1326,1328,1334],{"type":67,"value":1327},"Runtime not found (e.g. ",{"type":61,"tag":91,"props":1329,"children":1331},{"className":1330},[],[1332],{"type":67,"value":1333},"java: command not found",{"type":67,"value":1335},")",{"type":61,"tag":716,"props":1337,"children":1338},{},[1339],{"type":67,"value":1340},"The language runtime isn't on the worker, or the executable path kwarg is wrong. Install the runtime and verify its version.",{"type":61,"tag":689,"props":1342,"children":1343},{},[1344,1349],{"type":61,"tag":716,"props":1345,"children":1346},{},[1347],{"type":67,"value":1348},"\"No artifact found\" \u002F \"no DAGs\" \u002F \"no bundle contains dag_id\"",{"type":61,"tag":716,"props":1350,"children":1351},{},[1352,1354,1359],{"type":67,"value":1353},"The artifact-directory kwarg points at the wrong place, the artifact isn't there yet, or its ",{"type":61,"tag":91,"props":1355,"children":1357},{"className":1356},[],[1358],{"type":67,"value":1140},{"type":67,"value":1360}," doesn't match the stub. Confirm the path and the IDs.",{"type":61,"tag":689,"props":1362,"children":1363},{},[1364,1369],{"type":61,"tag":716,"props":1365,"children":1366},{},[1367],{"type":67,"value":1368},"Wrong\u002Fambiguous entry point (Java)",{"type":61,"tag":716,"props":1370,"children":1371},{},[1372,1374,1379,1381,1386],{"type":67,"value":1373},"Multiple executable JARs under ",{"type":61,"tag":91,"props":1375,"children":1377},{"className":1376},[],[1378],{"type":67,"value":724},{"type":67,"value":1380},". Set ",{"type":61,"tag":91,"props":1382,"children":1384},{"className":1383},[],[1385],{"type":67,"value":842},{"type":67,"value":1387}," explicitly.",{"type":61,"tag":689,"props":1389,"children":1390},{},[1391,1396],{"type":61,"tag":716,"props":1392,"children":1393},{},[1394],{"type":67,"value":1395},"Go bundle is skipped silently",{"type":61,"tag":716,"props":1397,"children":1398},{},[1399],{"type":67,"value":1400},"Not a valid AFBNDL01 bundle, or its integrity hash failed (re-pack after any strip\u002Fsign\u002Frebuild).",{"type":61,"tag":689,"props":1402,"children":1403},{},[1404,1414],{"type":61,"tag":716,"props":1405,"children":1406},{},[1407,1412],{"type":61,"tag":91,"props":1408,"children":1410},{"className":1409},[],[1411],{"type":67,"value":1080},{"type":67,"value":1413}," on the Go bundle",{"type":61,"tag":716,"props":1415,"children":1416},{},[1417,1419,1425,1427,1433,1435,1439],{"type":67,"value":1418},"Built for a different OS\u002Farch than the worker. Cross-compile with ",{"type":61,"tag":91,"props":1420,"children":1422},{"className":1421},[],[1423],{"type":67,"value":1424},"--goos",{"type":67,"value":1426},"\u002F",{"type":61,"tag":91,"props":1428,"children":1430},{"className":1429},[],[1431],{"type":67,"value":1432},"--goarch",{"type":67,"value":1434}," (see ",{"type":61,"tag":76,"props":1436,"children":1437},{},[1438],{"type":67,"value":160},{"type":67,"value":162},{"type":61,"tag":689,"props":1441,"children":1442},{},[1443,1448],{"type":61,"tag":716,"props":1444,"children":1445},{},[1446],{"type":67,"value":1447},"DAG run hangs at the native task",{"type":61,"tag":716,"props":1449,"children":1450},{},[1451,1453,1458,1459,1465],{"type":67,"value":1452},"Raise ",{"type":61,"tag":91,"props":1454,"children":1456},{"className":1455},[],[1457],{"type":67,"value":889},{"type":67,"value":1241},{"type":61,"tag":91,"props":1460,"children":1462},{"className":1461},[],[1463],{"type":67,"value":1464},"30.0",{"type":67,"value":1466},"); first-run subprocess startup can be slow.",{"type":61,"tag":164,"props":1468,"children":1469},{},[],{"type":61,"tag":168,"props":1471,"children":1473},{"id":1472},"related-skills",[1474],{"type":67,"value":1475},"Related Skills",{"type":61,"tag":175,"props":1477,"children":1478},{},[1479,1488,1497,1506,1515,1524],{"type":61,"tag":179,"props":1480,"children":1481},{},[1482,1486],{"type":61,"tag":76,"props":1483,"children":1484},{},[1485],{"type":67,"value":133},{"type":67,"value":1487},": The shared Python-stub pattern and conceptual model.",{"type":61,"tag":179,"props":1489,"children":1490},{},[1491,1495],{"type":61,"tag":76,"props":1492,"children":1493},{},[1494],{"type":67,"value":140},{"type":67,"value":1496},": Java task code and matching Python stubs.",{"type":61,"tag":179,"props":1498,"children":1499},{},[1500,1504],{"type":61,"tag":76,"props":1501,"children":1502},{},[1503],{"type":67,"value":154},{"type":67,"value":1505},": Build the bundle and put the artifact where the coordinator scans.",{"type":61,"tag":179,"props":1507,"children":1508},{},[1509,1513],{"type":61,"tag":76,"props":1510,"children":1511},{},[1512],{"type":67,"value":147},{"type":67,"value":1514},": Go task code and matching Python stubs.",{"type":61,"tag":179,"props":1516,"children":1517},{},[1518,1522],{"type":61,"tag":76,"props":1519,"children":1520},{},[1521],{"type":67,"value":160},{"type":67,"value":1523},": Build\u002Fpack the Go bundle and place it where the coordinator scans.",{"type":61,"tag":179,"props":1525,"children":1526},{},[1527,1532],{"type":61,"tag":76,"props":1528,"children":1529},{},[1530],{"type":67,"value":1531},"deploying-airflow",{"type":67,"value":1533},": General deployment of Airflow on Astro, Docker Compose, or Kubernetes.",{"type":61,"tag":1535,"props":1536,"children":1537},"style",{},[1538],{"type":67,"value":1539},"html .light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html.light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"items":1541,"total":1701},[1542,1556,1568,1585,1599,1616,1629,1642,1656,1666,1675,1688],{"slug":18,"name":18,"fn":1543,"description":1544,"org":1545,"tags":1546,"stars":25,"repoUrl":26,"updatedAt":1555},"manage and troubleshoot Airflow via CLI","Queries, manages, and troubleshoots Apache Airflow using the `af` CLI. Use when working with anything related to Airflow - a DAG, a DAG run, a task log, an import or parse error, a broken DAG, or any Airflow operation. Covers listing and triggering DAGs, retrying runs, reading task logs, diagnosing failures, debugging import and parse errors, checking connections, variables and pools, exploring the REST API, and monitoring health (for example \"trigger a pipeline\", \"retry a run\", \"list connections\", \"check Airflow health\", \"why did my DAG fail\"). This is the entrypoint that routes to sibling skills for authoring, testing, deploying, and migrating Airflow 2 to 3. Not for warehouse\u002FSQL analytics on Airflow metadata tables (use analyzing-data); for deep root-cause reports use debugging-dags or airflow-investigation.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1547,1548,1551,1552],{"name":17,"slug":18,"type":15},{"name":1549,"slug":1550,"type":15},"CLI","cli",{"name":20,"slug":21,"type":15},{"name":1553,"slug":1554,"type":15},"Debugging","debugging","2026-04-06T18:01:43.992997",{"slug":1557,"name":1557,"fn":1558,"description":1559,"org":1560,"tags":1561,"stars":25,"repoUrl":26,"updatedAt":1567},"airflow-hitl","add human-in-the-loop steps to Airflow DAGs","Builds human-in-the-loop (HITL) Airflow workflows - approval gates, form input, and human-driven branching. Use when a DAG needs a human in the loop - an approval or reject step, sign-off before a task runs, a decision or approval UI, branching on a human choice, or collecting form input mid-run; also on mentions of ApprovalOperator, HITLOperator, HITLBranchOperator, HITLEntryOperator, or HITLTrigger. Requires Airflow 3.1+. Not for AI\u002FLLM task calls (see migrating-ai-sdk-to-common-ai).",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1562,1563,1566],{"name":17,"slug":18,"type":15},{"name":1564,"slug":1565,"type":15},"Approvals","approvals",{"name":20,"slug":21,"type":15},"2026-04-06T18:01:46.758548",{"slug":1569,"name":1569,"fn":1570,"description":1571,"org":1572,"tags":1573,"stars":25,"repoUrl":26,"updatedAt":1584},"airflow-plugins","build Airflow UI plugins","Builds Airflow 3.1+ plugins that embed FastAPI apps, custom UI pages, React components, middleware, macros, and operator links directly into the Airflow UI. Use when building anything custom inside Airflow 3.1+ that involves Python and a browser-facing interface - creating an Airflow plugin, adding a custom UI page or nav entry, building FastAPI-backed endpoints inside Airflow, serving static assets from a plugin, embedding a React app, adding middleware to the API server, creating custom operator extra links, or calling the Airflow REST API from inside a plugin; also when AirflowPlugin, fastapi_apps, external_views, react_apps, or plugin registration come up.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1574,1575,1578,1581],{"name":17,"slug":18,"type":15},{"name":1576,"slug":1577,"type":15},"Plugin Development","plugin-development",{"name":1579,"slug":1580,"type":15},"Python","python",{"name":1582,"slug":1583,"type":15},"UI Components","ui-components","2026-04-06T18:01:56.827891",{"slug":1586,"name":1586,"fn":1587,"description":1588,"org":1589,"tags":1590,"stars":25,"repoUrl":26,"updatedAt":1598},"airflow-state-store","persist Airflow task and asset state","Persists task and asset state across retries and DAG runs using Airflow 3.3's AIP-103 key\u002Fvalue stores (`task_state_store`, `asset_state_store`) and the crash-safe `ResumableJobMixin`. Use when the user asks about task state store, checkpointing in tasks, persisting state across retries, job IDs surviving worker crashes, watermarks, asset metadata, resumable tasks, crash-safe operators, or \"what's new in Airflow 3.3\". Also use proactively when reading a DAG that uses Variables or XCom for intra-task coordination state — flag the anti-pattern and recommend task_state_store or asset_state_store instead. Requires Airflow 3.3+.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1591,1592,1594,1595],{"name":17,"slug":18,"type":15},{"name":1593,"slug":39,"type":15},"Data Engineering",{"name":20,"slug":21,"type":15},{"name":1596,"slug":1597,"type":15},"Operations","operations","2026-07-07T06:43:11.160671",{"slug":1600,"name":1600,"fn":1601,"description":1602,"org":1603,"tags":1604,"stars":25,"repoUrl":26,"updatedAt":1615},"analyzing-data","query data warehouses for business questions","Queries the data warehouse with SQL and answers business questions about data. Use when answering anything that needs warehouse data - counts, metrics, trends, aggregations, joins across tables, data lookups, or ad-hoc SQL analysis (for example \"who uses X\", \"how many Y\", \"show me Z\", \"find customers\", \"what is the count\").",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1605,1608,1611,1612],{"name":1606,"slug":1607,"type":15},"Analytics","analytics",{"name":1609,"slug":1610,"type":15},"Data Analysis","data-analysis",{"name":1593,"slug":39,"type":15},{"name":1613,"slug":1614,"type":15},"SQL","sql","2026-04-06T18:01:49.599775",{"slug":1617,"name":1617,"fn":1618,"description":1619,"org":1620,"tags":1621,"stars":25,"repoUrl":26,"updatedAt":1628},"annotating-task-lineage","annotate Airflow tasks with data lineage","Annotate Airflow tasks with data lineage using inlets and outlets. Use when the user wants to add lineage metadata to tasks, specify input\u002Foutput datasets, or enable lineage tracking for operators without built-in OpenLineage extraction.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1622,1623,1624,1625],{"name":17,"slug":18,"type":15},{"name":1593,"slug":39,"type":15},{"name":20,"slug":21,"type":15},{"name":1626,"slug":1627,"type":15},"Observability","observability","2026-04-06T18:02:03.487365",{"slug":1630,"name":1630,"fn":1631,"description":1632,"org":1633,"tags":1634,"stars":25,"repoUrl":26,"updatedAt":1641},"authoring-dags","author Airflow DAGs","Workflow and best practices for writing Apache Airflow DAGs. Use when creating a new DAG, write pipeline code, handling questions about DAG patterns and conventions or extending an existing DAG with a follow-up\u002Fdownstream task. ANY request shaped like 'add a DAG named X', 'write a pipeline', 'add a task that runs after Y', or 'extend the DAG'. For testing and debugging DAGs, see the testing-dags skill.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1635,1636,1637,1640],{"name":17,"slug":18,"type":15},{"name":20,"slug":21,"type":15},{"name":1638,"slug":1639,"type":15},"ETL","etl",{"name":1579,"slug":1580,"type":15},"2026-04-06T18:01:52.679888",{"slug":147,"name":147,"fn":1643,"description":1644,"org":1645,"tags":1646,"stars":25,"repoUrl":26,"updatedAt":1655},"implement Airflow tasks in Go","Writes Airflow task logic in Go using the Airflow Go SDK. Use when the user wants to implement Airflow tasks in Go, asks about `BundleProvider`\u002F`RegisterDags`, the `bundlev1` Registry\u002FDag interfaces, registering Go tasks (`AddTask`\u002F`AddTaskWithName`), dependency injection by parameter type (`context.Context`, `sdk.TIRunContext`, `*slog.Logger`, `sdk.Client`), or reading connections\u002Fvariables\u002FXComs from Go. This skill covers the Go-specific native API; the shared Python-stub pattern and conceptual model live in authoring-language-sdk-tasks. For building\u002Fpacking\u002Fshipping the bundle see deploying-go-sdk-bundles; for coordinator config see configuring-airflow-language-sdks.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1647,1648,1651,1652],{"name":17,"slug":18,"type":15},{"name":1649,"slug":1650,"type":15},"API Development","api-development",{"name":20,"slug":21,"type":15},{"name":1653,"slug":1654,"type":15},"Go","go","2026-07-11T05:39:13.552213",{"slug":140,"name":140,"fn":1657,"description":1658,"org":1659,"tags":1660,"stars":25,"repoUrl":26,"updatedAt":1665},"implement Airflow tasks in Java","Writes Airflow task logic in Java, Kotlin, or any JVM language using the Airflow Java SDK. Use when the user wants to implement Airflow tasks in Java\u002FJVM, asks about `@Builder.Dag`\u002F`@Builder.Task`\u002F`@Builder.XCom`, the `Task`\u002F`BundleBuilder` interfaces, reading connections\u002Fvariables\u002FXComs from Java, the JSON-to-Java type mapping, or logging from Java tasks. This skill covers the Java-specific native API; the shared Python-stub pattern and conceptual model live in authoring-language-sdk-tasks. For building\u002Fshipping the bundle see deploying-java-sdk-bundles; for coordinator config see configuring-airflow-language-sdks.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1661,1662,1663],{"name":20,"slug":21,"type":15},{"name":23,"slug":24,"type":15},{"name":1664,"slug":662,"type":15},"Java","2026-07-18T05:48:13.374003",{"slug":133,"name":133,"fn":1667,"description":1668,"org":1669,"tags":1670,"stars":25,"repoUrl":26,"updatedAt":1674},"implement non-Python Airflow tasks","The language-neutral foundation for Airflow language SDKs — implement task logic in a non-Python language while the DAG stays in Python. Use when the user wants to run an Airflow task in another language (Java, Kotlin, Go, or other JVM\u002Fnative languages), asks how the Python `@task.stub` pairs with native task code, how task\u002FDAG IDs must match across the two sides, how data passes via XCom as JSON, or which language SDKs exist. This skill owns the shared Python-stub pattern and conceptual model; for a specific language's native API, build, and runtime, use that language's skill (e.g. authoring-java-sdk-tasks, authoring-go-sdk-tasks).",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1671,1672,1673],{"name":17,"slug":18,"type":15},{"name":20,"slug":21,"type":15},{"name":23,"slug":24,"type":15},"2026-07-18T05:11:54.496539",{"slug":1676,"name":1676,"fn":1677,"description":1678,"org":1679,"tags":1680,"stars":25,"repoUrl":26,"updatedAt":1687},"blueprint","build reusable Airflow task group templates","Define reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML. Use when creating blueprint templates, composing DAGs from YAML, validating configurations, or enabling no-code DAG authoring for non-engineers.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1681,1682,1683,1684],{"name":17,"slug":18,"type":15},{"name":20,"slug":21,"type":15},{"name":1638,"slug":1639,"type":15},{"name":1685,"slug":1686,"type":15},"Templates","templates","2026-04-06T18:01:45.361425",{"slug":1689,"name":1689,"fn":1690,"description":1691,"org":1692,"tags":1693,"stars":25,"repoUrl":26,"updatedAt":1700},"checking-freshness","check data freshness in warehouses","Quick data freshness check. Use when the user asks if data is up to date, when a table was last updated, if data is stale, or needs to verify data currency before using it.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1694,1695,1696,1699],{"name":17,"slug":18,"type":15},{"name":1593,"slug":39,"type":15},{"name":1697,"slug":1698,"type":15},"Data Quality","data-quality",{"name":1638,"slug":1639,"type":15},"2026-04-06T18:02:02.138565",34,{"items":1703,"total":1701},[1704,1711,1717,1724,1731,1738,1745],{"slug":18,"name":18,"fn":1543,"description":1544,"org":1705,"tags":1706,"stars":25,"repoUrl":26,"updatedAt":1555},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1707,1708,1709,1710],{"name":17,"slug":18,"type":15},{"name":1549,"slug":1550,"type":15},{"name":20,"slug":21,"type":15},{"name":1553,"slug":1554,"type":15},{"slug":1557,"name":1557,"fn":1558,"description":1559,"org":1712,"tags":1713,"stars":25,"repoUrl":26,"updatedAt":1567},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1714,1715,1716],{"name":17,"slug":18,"type":15},{"name":1564,"slug":1565,"type":15},{"name":20,"slug":21,"type":15},{"slug":1569,"name":1569,"fn":1570,"description":1571,"org":1718,"tags":1719,"stars":25,"repoUrl":26,"updatedAt":1584},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1720,1721,1722,1723],{"name":17,"slug":18,"type":15},{"name":1576,"slug":1577,"type":15},{"name":1579,"slug":1580,"type":15},{"name":1582,"slug":1583,"type":15},{"slug":1586,"name":1586,"fn":1587,"description":1588,"org":1725,"tags":1726,"stars":25,"repoUrl":26,"updatedAt":1598},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1727,1728,1729,1730],{"name":17,"slug":18,"type":15},{"name":1593,"slug":39,"type":15},{"name":20,"slug":21,"type":15},{"name":1596,"slug":1597,"type":15},{"slug":1600,"name":1600,"fn":1601,"description":1602,"org":1732,"tags":1733,"stars":25,"repoUrl":26,"updatedAt":1615},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1734,1735,1736,1737],{"name":1606,"slug":1607,"type":15},{"name":1609,"slug":1610,"type":15},{"name":1593,"slug":39,"type":15},{"name":1613,"slug":1614,"type":15},{"slug":1617,"name":1617,"fn":1618,"description":1619,"org":1739,"tags":1740,"stars":25,"repoUrl":26,"updatedAt":1628},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1741,1742,1743,1744],{"name":17,"slug":18,"type":15},{"name":1593,"slug":39,"type":15},{"name":20,"slug":21,"type":15},{"name":1626,"slug":1627,"type":15},{"slug":1630,"name":1630,"fn":1631,"description":1632,"org":1746,"tags":1747,"stars":25,"repoUrl":26,"updatedAt":1641},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[1748,1749,1750,1751],{"name":17,"slug":18,"type":15},{"name":20,"slug":21,"type":15},{"name":1638,"slug":1639,"type":15},{"name":1579,"slug":1580,"type":15}]