[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill-databricks-databricks-jobs":3,"mdc--doftdr-key":33,"related-org-databricks-databricks-jobs":3805,"related-repo-databricks-databricks-jobs":3986},{"slug":4,"name":4,"fn":5,"description":6,"org":7,"tags":11,"stars":23,"repoUrl":24,"updatedAt":25,"license":26,"forks":27,"topics":28,"repo":29,"sourceUrl":31,"mdContent":32},"databricks-jobs","develop and deploy Databricks Lakeflow jobs","Develop and deploy Lakeflow Jobs on Databricks via DABs, Python SDK, or the CLI. Use when creating data engineering jobs with notebooks, Python wheels, SQL, dbt, or pipelines. Invoke BEFORE starting implementation.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},"databricks","Databricks","https:\u002F\u002Fpexgzepcugksgbtrxkhf.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Forg-logos\u002Fdatabricks.png",[12,16,19,22],{"name":13,"slug":14,"type":15},"Data Engineering","data-engineering","tag",{"name":17,"slug":18,"type":15},"Data Pipeline","data-pipeline",{"name":20,"slug":21,"type":15},"Deployment","deployment",{"name":9,"slug":8,"type":15},204,"https:\u002F\u002Fgithub.com\u002Fdatabricks\u002Fdatabricks-agent-skills","2026-07-15T05:41:33.465258",null,60,[],{"repoUrl":24,"stars":23,"forks":27,"topics":30,"description":26},[],"https:\u002F\u002Fgithub.com\u002Fdatabricks\u002Fdatabricks-agent-skills\u002Ftree\u002FHEAD\u002Fplugins\u002Fdatabricks\u002Fcopilot\u002Fskills\u002Fdatabricks-jobs","---\nname: databricks-jobs\ndescription: Develop and deploy Lakeflow Jobs on Databricks via DABs, Python SDK, or the CLI. Use when creating data engineering jobs with notebooks, Python wheels, SQL, dbt, or pipelines. Invoke BEFORE starting implementation.\ncompatibility: Requires databricks CLI (>= v1.0.0)\nmetadata:\n  version: \"0.2.0\"\nparent: databricks-core\n---\n\n# Lakeflow Jobs Development\n\n**FIRST**: Use the parent `databricks-core` skill for CLI basics, authentication, profile selection, and data exploration commands.\n\nLakeflow Jobs orchestrate data workflows with multi-task DAGs, flexible triggers, and comprehensive monitoring. Jobs support diverse task types and can be managed via Asset Bundles (DABs), Python SDK, or CLI.\n\n## Reference Files\n\n| Use Case | Reference File |\n|----------|----------------|\n| Configure task types (notebook, Python, SQL, dbt, pipeline, JAR, run_job, for_each) | [references\u002Ftask-types.md](references\u002Ftask-types.md) |\n| Set up triggers and schedules (cron, periodic, file arrival, table update, continuous) | [references\u002Ftriggers-schedules.md](references\u002Ftriggers-schedules.md) |\n| Configure notifications, health rules, retries, timeouts, queues | [references\u002Fnotifications-monitoring.md](references\u002Fnotifications-monitoring.md) |\n| Complete worked examples (ETL, warehouse refresh, event-driven, ML training, multi-env, streaming, cross-job) | [references\u002Fexamples.md](references\u002Fexamples.md) |\n\n## Scaffolding a New Job Project\n\nUse `databricks bundle init` with a config file to scaffold non-interactively. This creates a project in the `\u003Cproject_name>\u002F` directory:\n\n```bash\ndatabricks bundle init default-python --config-file \u003C(echo '{\"project_name\": \"my_job\", \"include_job\": \"yes\", \"include_pipeline\": \"no\", \"include_python\": \"yes\", \"serverless\": \"yes\"}') --profile \u003CPROFILE> \u003C \u002Fdev\u002Fnull\n```\n\n- `project_name`: letters, numbers, underscores only\n\nAfter scaffolding, create `CLAUDE.md` and `AGENTS.md` in the project directory. These files are essential to provide agents with guidance on how to work with the project. Use this content:\n\n```\n# Declarative Automation Bundles Project\n\nThis project uses Declarative Automation Bundles (formerly Databricks Asset Bundles) for deployment.\n\n## Prerequisites\n\nInstall the Databricks CLI (>= v0.288.0) if not already installed:\n- macOS: `brew tap databricks\u002Ftap && brew install databricks`\n- Linux: `curl -fsSL https:\u002F\u002Fraw.githubusercontent.com\u002Fdatabricks\u002Fsetup-cli\u002Fmain\u002Finstall.sh | sh`\n- Windows: `winget install Databricks.DatabricksCLI`\n\nVerify: `databricks -v`\n\n## For AI Agents\n\nRead the `databricks-core` skill for CLI basics, authentication, and deployment workflow.\nRead the `databricks-jobs` skill for job-specific guidance.\n\nIf skills are not available, install them: `databricks aitools install`\n```\n\n## Project Structure\n\n```\nmy-job-project\u002F\n├── databricks.yml              # Bundle configuration\n├── resources\u002F\n│   └── my_job.job.yml          # Job definition\n├── src\u002F\n│   ├── my_notebook.ipynb       # Notebook tasks\n│   └── my_module\u002F              # Python wheel package\n│       ├── __init__.py\n│       └── main.py\n├── tests\u002F\n│   └── test_main.py\n└── pyproject.toml              # Python project config (if using wheels)\n```\n\n## Quick Start\n\n### Asset Bundles (DABs) — recommended\n\n```yaml\n# resources\u002Fjobs.yml\nresources:\n  jobs:\n    my_etl_job:\n      name: \"[${bundle.target}] My ETL Job\"\n      tasks:\n        - task_key: extract\n          notebook_task:\n            notebook_path: ..\u002Fsrc\u002Fnotebooks\u002Fextract.py\n```\n\n### Python SDK\n\n```python\nfrom databricks.sdk import WorkspaceClient\nfrom databricks.sdk.service.jobs import Task, NotebookTask, Source\n\nw = WorkspaceClient()\n\njob = w.jobs.create(\n    name=\"my-etl-job\",\n    tasks=[\n        Task(\n            task_key=\"extract\",\n            notebook_task=NotebookTask(\n                notebook_path=\"\u002FWorkspace\u002FShared\u002Fetl\u002Fextract\",\n                source=Source.WORKSPACE,\n            ),\n        ),\n    ],\n)\nprint(f\"Created job: {job.job_id}\")\n```\n\n### CLI\n\n```bash\ndatabricks jobs create --json '{\n  \"name\": \"my-etl-job\",\n  \"tasks\": [{\n    \"task_key\": \"extract\",\n    \"notebook_task\": {\n      \"notebook_path\": \"\u002FWorkspace\u002FShared\u002Fetl\u002Fextract\",\n      \"source\": \"WORKSPACE\"\n    }\n  }]\n}'\n```\n\n## Core Concepts\n\n### Multi-Task Workflows\n\nJobs support DAG-based task dependencies:\n\n```yaml\ntasks:\n  - task_key: extract\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fextract.py\n\n  - task_key: transform\n    depends_on:\n      - task_key: extract\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Ftransform.py\n\n  - task_key: load\n    depends_on:\n      - task_key: transform\n    run_if: ALL_SUCCESS  # Only run if all dependencies succeed\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fload.py\n```\n\n**run_if conditions:**\n\n- `ALL_SUCCESS` (default) — run when all dependencies succeed\n- `ALL_DONE` — run when all dependencies complete (success or failure)\n- `AT_LEAST_ONE_SUCCESS` — run when at least one dependency succeeds\n- `NONE_FAILED` — run when no dependencies failed\n- `ALL_FAILED` — run when all dependencies failed\n- `AT_LEAST_ONE_FAILED` — run when at least one dependency failed\n\n### Task Types Summary\n\n| Task Type | Use Case | Reference |\n|-----------|----------|-----------|\n| `notebook_task` | Run notebooks | [references\u002Ftask-types.md#notebook-task](references\u002Ftask-types.md#notebook-task) |\n| `spark_python_task` | Run Python scripts | [references\u002Ftask-types.md#spark-python-task](references\u002Ftask-types.md#spark-python-task) |\n| `python_wheel_task` | Run Python wheels | [references\u002Ftask-types.md#python-wheel-task](references\u002Ftask-types.md#python-wheel-task) |\n| `sql_task` | Run SQL queries\u002Ffiles\u002Fdashboards\u002Falerts | [references\u002Ftask-types.md#sql-task](references\u002Ftask-types.md#sql-task) |\n| `dbt_task` | Run dbt projects | [references\u002Ftask-types.md#dbt-task](references\u002Ftask-types.md#dbt-task) |\n| `pipeline_task` | Trigger SDP (formerly DLT) pipelines | [references\u002Ftask-types.md#pipeline-task](references\u002Ftask-types.md#pipeline-task) |\n| `spark_jar_task` | Run Spark JARs | [references\u002Ftask-types.md#spark-jar-task](references\u002Ftask-types.md#spark-jar-task) |\n| `run_job_task` | Trigger other jobs | [references\u002Ftask-types.md#run-job-task](references\u002Ftask-types.md#run-job-task) |\n| `for_each_task` | Loop over inputs | [references\u002Ftask-types.md#for-each-task](references\u002Ftask-types.md#for-each-task) |\n\n### Trigger Types Summary\n\n| Trigger Type | Use Case | Reference |\n|--------------|----------|-----------|\n| `schedule` | Cron-based scheduling | [references\u002Ftriggers-schedules.md#cron-schedule](references\u002Ftriggers-schedules.md#cron-schedule) |\n| `trigger.periodic` | Interval-based | [references\u002Ftriggers-schedules.md#periodic-trigger](references\u002Ftriggers-schedules.md#periodic-trigger) |\n| `trigger.file_arrival` | File arrival events | [references\u002Ftriggers-schedules.md#file-arrival-trigger](references\u002Ftriggers-schedules.md#file-arrival-trigger) |\n| `trigger.table_update` | Unity Catalog table change events | [references\u002Ftriggers-schedules.md#table-update-trigger](references\u002Ftriggers-schedules.md#table-update-trigger) |\n| `continuous` | Always-running jobs | [references\u002Ftriggers-schedules.md#continuous-jobs](references\u002Ftriggers-schedules.md#continuous-jobs) |\n\n## Compute Configuration\n\n### Job Clusters (recommended)\n\nDefine reusable cluster configurations shared across tasks:\n\n```yaml\njob_clusters:\n  - job_cluster_key: shared_cluster\n    new_cluster:\n      spark_version: \"15.4.x-scala2.12\"\n      node_type_id: \"i3.xlarge\"\n      num_workers: 2\n      spark_conf:\n        spark.speculation: \"true\"\n\ntasks:\n  - task_key: my_task\n    job_cluster_key: shared_cluster\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n```\n\n### Autoscaling Clusters\n\n```yaml\nnew_cluster:\n  spark_version: \"15.4.x-scala2.12\"\n  node_type_id: \"i3.xlarge\"\n  autoscale:\n    min_workers: 2\n    max_workers: 8\n```\n\n### Existing Cluster\n\n```yaml\ntasks:\n  - task_key: my_task\n    existing_cluster_id: \"0123-456789-abcdef12\"\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n```\n\n### Serverless Compute\n\nFor notebook and Python tasks, omit cluster configuration to use serverless:\n\n```yaml\ntasks:\n  - task_key: serverless_task\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n    # No cluster config = serverless\n```\n\n## Job Parameters\n\nParameters defined at job level are passed to ALL tasks (no need to repeat per task):\n\n```yaml\nparameters:\n  - name: env\n    default: \"dev\"\n  - name: date\n    default: \"{{start_date}}\"  # Dynamic value reference\n```\n\nAccess in notebooks:\n\n```python\ncatalog = dbutils.widgets.get(\"env\")\nload_date = dbutils.widgets.get(\"date\")\n```\n\nPass to specific tasks:\n\n```yaml\ntasks:\n  - task_key: my_task\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n      base_parameters:\n        env: \"{{job.parameters.env}}\"\n        custom_param: \"value\"\n```\n\n## Common Operations\n\n### Python SDK\n\n```python\nfrom databricks.sdk import WorkspaceClient\n\nw = WorkspaceClient()\n\n# List jobs\njobs = w.jobs.list()\n\n# Get job details\njob = w.jobs.get(job_id=12345)\n\n# Run job now\nrun = w.jobs.run_now(job_id=12345)\n\n# Run with parameters\nrun = w.jobs.run_now(\n    job_id=12345,\n    job_parameters={\"env\": \"prod\", \"date\": \"2024-01-15\"},\n)\n\n# Cancel run\nw.jobs.cancel_run(run_id=run.run_id)\n\n# Delete job\nw.jobs.delete(job_id=12345)\n```\n\n### CLI\n\n```bash\n# List jobs\ndatabricks jobs list\n\n# Get job details\ndatabricks jobs get 12345\n\n# Run job\ndatabricks jobs run-now 12345\n\n# Run with parameters (must use --json with job_id inside)\ndatabricks jobs run-now --json '{\"job_id\": 12345, \"job_parameters\": {\"env\": \"prod\"}}'\n\n# Cancel run\ndatabricks jobs cancel-run 67890\n\n# Delete job\ndatabricks jobs delete 12345\n```\n\n### Asset Bundle Operations\n\n```bash\n# Validate configuration\ndatabricks bundle validate --profile \u003Cprofile>\n\n# Deploy to a target\ndatabricks bundle deploy -t dev --profile \u003Cprofile>\n\n# Run a job\ndatabricks bundle run \u003Cjob_name> -t dev --profile \u003Cprofile>\n\n# Check run status\ndatabricks jobs get-run --run-id \u003Cid> --profile \u003Cprofile>\n\n# Destroy resources\ndatabricks bundle destroy --auto-approve\n```\n\n## Permissions (DABs)\n\n```yaml\nresources:\n  jobs:\n    my_job:\n      name: \"My Job\"\n      permissions:\n        - level: CAN_VIEW\n          group_name: \"data-analysts\"\n        - level: CAN_MANAGE_RUN\n          group_name: \"data-engineers\"\n        - level: CAN_MANAGE\n          user_name: \"admin@example.com\"\n```\n\n**Permission levels:**\n\n- `CAN_VIEW` — view job and run history\n- `CAN_MANAGE_RUN` — view, trigger, and cancel runs\n- `CAN_MANAGE` — full control including edit and delete\n\n## Unit Testing\n\nRun unit tests locally:\n\n```bash\nuv run pytest\n```\n\n## Development Workflow\n\n1. **Validate**: `databricks bundle validate --profile \u003Cprofile>`\n2. **Deploy**: `databricks bundle deploy -t dev --profile \u003Cprofile>`\n3. **Run**: `databricks bundle run \u003Cjob_name> -t dev --profile \u003Cprofile>`\n4. **Check run status**: `databricks jobs get-run --run-id \u003Cid> --profile \u003Cprofile>`\n\n## Common Issues\n\n| Issue | Solution |\n|-------|----------|\n| Job cluster startup slow | Use job clusters with `job_cluster_key` for reuse across tasks |\n| Task dependencies not working | Verify `task_key` references match exactly in `depends_on` |\n| Schedule not triggering | Check `pause_status: UNPAUSED` and valid timezone |\n| File arrival not detecting | Ensure path has proper permissions and uses cloud storage URL |\n| Table update trigger missing events | Verify Unity Catalog table and proper grants |\n| Parameter not accessible | Use `dbutils.widgets.get()` in notebooks |\n| `admins` group error | Cannot modify admins permissions on jobs |\n| Serverless task fails | Ensure task type supports serverless (notebook, Python) |\n\n## Related Skills\n\n- **databricks-dabs** — DABs configuration patterns shared by jobs and pipelines\n- **databricks-pipelines** — SDP (formerly DLT) pipelines triggered by `pipeline_task`\n\n## Documentation\n\n- [Lakeflow Jobs](https:\u002F\u002Fdocs.databricks.com\u002Fjobs)\n- [Task types](https:\u002F\u002Fdocs.databricks.com\u002Fjobs\u002Fconfigure-task)\n- [Declarative Automation Bundles](https:\u002F\u002Fdocs.databricks.com\u002Fdev-tools\u002Fbundles\u002F)\n- [Jobs API Reference](https:\u002F\u002Fdocs.databricks.com\u002Fapi\u002Fworkspace\u002Fjobs)\n- [Bundle Examples Repository](https:\u002F\u002Fgithub.com\u002Fdatabricks\u002Fbundle-examples)\n",{"data":34,"body":39},{"name":4,"description":6,"compatibility":35,"metadata":36,"parent":38},"Requires databricks CLI (>= v1.0.0)",{"version":37},"0.2.0","databricks-core",{"type":40,"children":41},"root",[42,51,71,76,83,176,182,203,308,324,345,355,361,370,376,383,538,544,706,712,827,833,839,844,1104,1112,1181,1187,1438,1444,1594,1600,1606,1611,1849,1855,1967,1973,2061,2067,2072,2144,2150,2155,2270,2275,2298,2303,2428,2434,2439,2634,2639,2855,2861,3162,3168,3380,3388,3424,3430,3435,3459,3465,3530,3536,3705,3711,3739,3745,3799],{"type":43,"tag":44,"props":45,"children":47},"element","h1",{"id":46},"lakeflow-jobs-development",[48],{"type":49,"value":50},"text","Lakeflow Jobs Development",{"type":43,"tag":52,"props":53,"children":54},"p",{},[55,61,63,69],{"type":43,"tag":56,"props":57,"children":58},"strong",{},[59],{"type":49,"value":60},"FIRST",{"type":49,"value":62},": Use the parent ",{"type":43,"tag":64,"props":65,"children":67},"code",{"className":66},[],[68],{"type":49,"value":38},{"type":49,"value":70}," skill for CLI basics, authentication, profile selection, and data exploration commands.",{"type":43,"tag":52,"props":72,"children":73},{},[74],{"type":49,"value":75},"Lakeflow Jobs orchestrate data workflows with multi-task DAGs, flexible triggers, and comprehensive monitoring. Jobs support diverse task types and can be managed via Asset Bundles (DABs), Python SDK, or CLI.",{"type":43,"tag":77,"props":78,"children":80},"h2",{"id":79},"reference-files",[81],{"type":49,"value":82},"Reference Files",{"type":43,"tag":84,"props":85,"children":86},"table",{},[87,106],{"type":43,"tag":88,"props":89,"children":90},"thead",{},[91],{"type":43,"tag":92,"props":93,"children":94},"tr",{},[95,101],{"type":43,"tag":96,"props":97,"children":98},"th",{},[99],{"type":49,"value":100},"Use Case",{"type":43,"tag":96,"props":102,"children":103},{},[104],{"type":49,"value":105},"Reference File",{"type":43,"tag":107,"props":108,"children":109},"tbody",{},[110,128,144,160],{"type":43,"tag":92,"props":111,"children":112},{},[113,119],{"type":43,"tag":114,"props":115,"children":116},"td",{},[117],{"type":49,"value":118},"Configure task types (notebook, Python, SQL, dbt, pipeline, JAR, run_job, for_each)",{"type":43,"tag":114,"props":120,"children":121},{},[122],{"type":43,"tag":123,"props":124,"children":126},"a",{"href":125},"references\u002Ftask-types.md",[127],{"type":49,"value":125},{"type":43,"tag":92,"props":129,"children":130},{},[131,136],{"type":43,"tag":114,"props":132,"children":133},{},[134],{"type":49,"value":135},"Set up triggers and schedules (cron, periodic, file arrival, table update, continuous)",{"type":43,"tag":114,"props":137,"children":138},{},[139],{"type":43,"tag":123,"props":140,"children":142},{"href":141},"references\u002Ftriggers-schedules.md",[143],{"type":49,"value":141},{"type":43,"tag":92,"props":145,"children":146},{},[147,152],{"type":43,"tag":114,"props":148,"children":149},{},[150],{"type":49,"value":151},"Configure notifications, health rules, retries, timeouts, queues",{"type":43,"tag":114,"props":153,"children":154},{},[155],{"type":43,"tag":123,"props":156,"children":158},{"href":157},"references\u002Fnotifications-monitoring.md",[159],{"type":49,"value":157},{"type":43,"tag":92,"props":161,"children":162},{},[163,168],{"type":43,"tag":114,"props":164,"children":165},{},[166],{"type":49,"value":167},"Complete worked examples (ETL, warehouse refresh, event-driven, ML training, multi-env, streaming, cross-job)",{"type":43,"tag":114,"props":169,"children":170},{},[171],{"type":43,"tag":123,"props":172,"children":174},{"href":173},"references\u002Fexamples.md",[175],{"type":49,"value":173},{"type":43,"tag":77,"props":177,"children":179},{"id":178},"scaffolding-a-new-job-project",[180],{"type":49,"value":181},"Scaffolding a New Job Project",{"type":43,"tag":52,"props":183,"children":184},{},[185,187,193,195,201],{"type":49,"value":186},"Use ",{"type":43,"tag":64,"props":188,"children":190},{"className":189},[],[191],{"type":49,"value":192},"databricks bundle init",{"type":49,"value":194}," with a config file to scaffold non-interactively. This creates a project in the ",{"type":43,"tag":64,"props":196,"children":198},{"className":197},[],[199],{"type":49,"value":200},"\u003Cproject_name>\u002F",{"type":49,"value":202}," directory:",{"type":43,"tag":204,"props":205,"children":210},"pre",{"className":206,"code":207,"language":208,"meta":209,"style":209},"language-bash shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","databricks bundle init default-python --config-file \u003C(echo '{\"project_name\": \"my_job\", \"include_job\": \"yes\", \"include_pipeline\": \"no\", \"include_python\": \"yes\", \"serverless\": \"yes\"}') --profile \u003CPROFILE> \u003C \u002Fdev\u002Fnull\n","bash","",[211],{"type":43,"tag":64,"props":212,"children":213},{"__ignoreMap":209},[214],{"type":43,"tag":215,"props":216,"children":219},"span",{"class":217,"line":218},"line",1,[220,225,231,236,241,246,252,258,263,268,273,278,283,288,294,299,303],{"type":43,"tag":215,"props":221,"children":223},{"style":222},"--shiki-light:#E2931D;--shiki-default:#FFCB6B;--shiki-dark:#FFCB6B",[224],{"type":49,"value":8},{"type":43,"tag":215,"props":226,"children":228},{"style":227},"--shiki-light:#91B859;--shiki-default:#C3E88D;--shiki-dark:#C3E88D",[229],{"type":49,"value":230}," bundle",{"type":43,"tag":215,"props":232,"children":233},{"style":227},[234],{"type":49,"value":235}," init",{"type":43,"tag":215,"props":237,"children":238},{"style":227},[239],{"type":49,"value":240}," default-python",{"type":43,"tag":215,"props":242,"children":243},{"style":227},[244],{"type":49,"value":245}," --config-file",{"type":43,"tag":215,"props":247,"children":249},{"style":248},"--shiki-light:#39ADB5;--shiki-default:#89DDFF;--shiki-dark:#89DDFF",[250],{"type":49,"value":251}," \u003C(",{"type":43,"tag":215,"props":253,"children":255},{"style":254},"--shiki-light:#6182B8;--shiki-default:#82AAFF;--shiki-dark:#82AAFF",[256],{"type":49,"value":257},"echo",{"type":43,"tag":215,"props":259,"children":260},{"style":248},[261],{"type":49,"value":262}," '",{"type":43,"tag":215,"props":264,"children":265},{"style":227},[266],{"type":49,"value":267},"{\"project_name\": \"my_job\", \"include_job\": \"yes\", \"include_pipeline\": \"no\", \"include_python\": \"yes\", \"serverless\": \"yes\"}",{"type":43,"tag":215,"props":269,"children":270},{"style":248},[271],{"type":49,"value":272},"')",{"type":43,"tag":215,"props":274,"children":275},{"style":227},[276],{"type":49,"value":277}," --profile",{"type":43,"tag":215,"props":279,"children":280},{"style":248},[281],{"type":49,"value":282}," \u003C",{"type":43,"tag":215,"props":284,"children":285},{"style":227},[286],{"type":49,"value":287},"PROFIL",{"type":43,"tag":215,"props":289,"children":291},{"style":290},"--shiki-light:#90A4AE;--shiki-default:#EEFFFF;--shiki-dark:#BABED8",[292],{"type":49,"value":293},"E",{"type":43,"tag":215,"props":295,"children":296},{"style":248},[297],{"type":49,"value":298},">",{"type":43,"tag":215,"props":300,"children":301},{"style":248},[302],{"type":49,"value":282},{"type":43,"tag":215,"props":304,"children":305},{"style":227},[306],{"type":49,"value":307}," \u002Fdev\u002Fnull\n",{"type":43,"tag":309,"props":310,"children":311},"ul",{},[312],{"type":43,"tag":313,"props":314,"children":315},"li",{},[316,322],{"type":43,"tag":64,"props":317,"children":319},{"className":318},[],[320],{"type":49,"value":321},"project_name",{"type":49,"value":323},": letters, numbers, underscores only",{"type":43,"tag":52,"props":325,"children":326},{},[327,329,335,337,343],{"type":49,"value":328},"After scaffolding, create ",{"type":43,"tag":64,"props":330,"children":332},{"className":331},[],[333],{"type":49,"value":334},"CLAUDE.md",{"type":49,"value":336}," and ",{"type":43,"tag":64,"props":338,"children":340},{"className":339},[],[341],{"type":49,"value":342},"AGENTS.md",{"type":49,"value":344}," in the project directory. These files are essential to provide agents with guidance on how to work with the project. Use this content:",{"type":43,"tag":204,"props":346,"children":350},{"className":347,"code":349,"language":49},[348],"language-text","# Declarative Automation Bundles Project\n\nThis project uses Declarative Automation Bundles (formerly Databricks Asset Bundles) for deployment.\n\n## Prerequisites\n\nInstall the Databricks CLI (>= v0.288.0) if not already installed:\n- macOS: `brew tap databricks\u002Ftap && brew install databricks`\n- Linux: `curl -fsSL https:\u002F\u002Fraw.githubusercontent.com\u002Fdatabricks\u002Fsetup-cli\u002Fmain\u002Finstall.sh | sh`\n- Windows: `winget install Databricks.DatabricksCLI`\n\nVerify: `databricks -v`\n\n## For AI Agents\n\nRead the `databricks-core` skill for CLI basics, authentication, and deployment workflow.\nRead the `databricks-jobs` skill for job-specific guidance.\n\nIf skills are not available, install them: `databricks aitools install`\n",[351],{"type":43,"tag":64,"props":352,"children":353},{"__ignoreMap":209},[354],{"type":49,"value":349},{"type":43,"tag":77,"props":356,"children":358},{"id":357},"project-structure",[359],{"type":49,"value":360},"Project Structure",{"type":43,"tag":204,"props":362,"children":365},{"className":363,"code":364,"language":49},[348],"my-job-project\u002F\n├── databricks.yml              # Bundle configuration\n├── resources\u002F\n│   └── my_job.job.yml          # Job definition\n├── src\u002F\n│   ├── my_notebook.ipynb       # Notebook tasks\n│   └── my_module\u002F              # Python wheel package\n│       ├── __init__.py\n│       └── main.py\n├── tests\u002F\n│   └── test_main.py\n└── pyproject.toml              # Python project config (if using wheels)\n",[366],{"type":43,"tag":64,"props":367,"children":368},{"__ignoreMap":209},[369],{"type":49,"value":364},{"type":43,"tag":77,"props":371,"children":373},{"id":372},"quick-start",[374],{"type":49,"value":375},"Quick Start",{"type":43,"tag":377,"props":378,"children":380},"h3",{"id":379},"asset-bundles-dabs-recommended",[381],{"type":49,"value":382},"Asset Bundles (DABs) — recommended",{"type":43,"tag":204,"props":384,"children":388},{"className":385,"code":386,"language":387,"meta":209,"style":209},"language-yaml shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","# resources\u002Fjobs.yml\nresources:\n  jobs:\n    my_etl_job:\n      name: \"[${bundle.target}] My ETL Job\"\n      tasks:\n        - task_key: extract\n          notebook_task:\n            notebook_path: ..\u002Fsrc\u002Fnotebooks\u002Fextract.py\n","yaml",[389],{"type":43,"tag":64,"props":390,"children":391},{"__ignoreMap":209},[392,401,416,429,442,471,484,507,520],{"type":43,"tag":215,"props":393,"children":394},{"class":217,"line":218},[395],{"type":43,"tag":215,"props":396,"children":398},{"style":397},"--shiki-light:#90A4AE;--shiki-light-font-style:italic;--shiki-default:#546E7A;--shiki-default-font-style:italic;--shiki-dark:#676E95;--shiki-dark-font-style:italic",[399],{"type":49,"value":400},"# resources\u002Fjobs.yml\n",{"type":43,"tag":215,"props":402,"children":404},{"class":217,"line":403},2,[405,411],{"type":43,"tag":215,"props":406,"children":408},{"style":407},"--shiki-light:#E53935;--shiki-default:#F07178;--shiki-dark:#F07178",[409],{"type":49,"value":410},"resources",{"type":43,"tag":215,"props":412,"children":413},{"style":248},[414],{"type":49,"value":415},":\n",{"type":43,"tag":215,"props":417,"children":419},{"class":217,"line":418},3,[420,425],{"type":43,"tag":215,"props":421,"children":422},{"style":407},[423],{"type":49,"value":424},"  jobs",{"type":43,"tag":215,"props":426,"children":427},{"style":248},[428],{"type":49,"value":415},{"type":43,"tag":215,"props":430,"children":432},{"class":217,"line":431},4,[433,438],{"type":43,"tag":215,"props":434,"children":435},{"style":407},[436],{"type":49,"value":437},"    my_etl_job",{"type":43,"tag":215,"props":439,"children":440},{"style":248},[441],{"type":49,"value":415},{"type":43,"tag":215,"props":443,"children":445},{"class":217,"line":444},5,[446,451,456,461,466],{"type":43,"tag":215,"props":447,"children":448},{"style":407},[449],{"type":49,"value":450},"      name",{"type":43,"tag":215,"props":452,"children":453},{"style":248},[454],{"type":49,"value":455},":",{"type":43,"tag":215,"props":457,"children":458},{"style":248},[459],{"type":49,"value":460}," \"",{"type":43,"tag":215,"props":462,"children":463},{"style":227},[464],{"type":49,"value":465},"[${bundle.target}] My ETL Job",{"type":43,"tag":215,"props":467,"children":468},{"style":248},[469],{"type":49,"value":470},"\"\n",{"type":43,"tag":215,"props":472,"children":474},{"class":217,"line":473},6,[475,480],{"type":43,"tag":215,"props":476,"children":477},{"style":407},[478],{"type":49,"value":479},"      tasks",{"type":43,"tag":215,"props":481,"children":482},{"style":248},[483],{"type":49,"value":415},{"type":43,"tag":215,"props":485,"children":487},{"class":217,"line":486},7,[488,493,498,502],{"type":43,"tag":215,"props":489,"children":490},{"style":248},[491],{"type":49,"value":492},"        -",{"type":43,"tag":215,"props":494,"children":495},{"style":407},[496],{"type":49,"value":497}," task_key",{"type":43,"tag":215,"props":499,"children":500},{"style":248},[501],{"type":49,"value":455},{"type":43,"tag":215,"props":503,"children":504},{"style":227},[505],{"type":49,"value":506}," extract\n",{"type":43,"tag":215,"props":508,"children":510},{"class":217,"line":509},8,[511,516],{"type":43,"tag":215,"props":512,"children":513},{"style":407},[514],{"type":49,"value":515},"          notebook_task",{"type":43,"tag":215,"props":517,"children":518},{"style":248},[519],{"type":49,"value":415},{"type":43,"tag":215,"props":521,"children":523},{"class":217,"line":522},9,[524,529,533],{"type":43,"tag":215,"props":525,"children":526},{"style":407},[527],{"type":49,"value":528},"            notebook_path",{"type":43,"tag":215,"props":530,"children":531},{"style":248},[532],{"type":49,"value":455},{"type":43,"tag":215,"props":534,"children":535},{"style":227},[536],{"type":49,"value":537}," ..\u002Fsrc\u002Fnotebooks\u002Fextract.py\n",{"type":43,"tag":377,"props":539,"children":541},{"id":540},"python-sdk",[542],{"type":49,"value":543},"Python SDK",{"type":43,"tag":204,"props":545,"children":549},{"className":546,"code":547,"language":548,"meta":209,"style":209},"language-python shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","from databricks.sdk import WorkspaceClient\nfrom databricks.sdk.service.jobs import Task, NotebookTask, Source\n\nw = WorkspaceClient()\n\njob = w.jobs.create(\n    name=\"my-etl-job\",\n    tasks=[\n        Task(\n            task_key=\"extract\",\n            notebook_task=NotebookTask(\n                notebook_path=\"\u002FWorkspace\u002FShared\u002Fetl\u002Fextract\",\n                source=Source.WORKSPACE,\n            ),\n        ),\n    ],\n)\nprint(f\"Created job: {job.job_id}\")\n","python",[550],{"type":43,"tag":64,"props":551,"children":552},{"__ignoreMap":209},[553,561,569,578,586,593,601,609,617,625,634,643,652,661,670,679,688,697],{"type":43,"tag":215,"props":554,"children":555},{"class":217,"line":218},[556],{"type":43,"tag":215,"props":557,"children":558},{},[559],{"type":49,"value":560},"from databricks.sdk import WorkspaceClient\n",{"type":43,"tag":215,"props":562,"children":563},{"class":217,"line":403},[564],{"type":43,"tag":215,"props":565,"children":566},{},[567],{"type":49,"value":568},"from databricks.sdk.service.jobs import Task, NotebookTask, Source\n",{"type":43,"tag":215,"props":570,"children":571},{"class":217,"line":418},[572],{"type":43,"tag":215,"props":573,"children":575},{"emptyLinePlaceholder":574},true,[576],{"type":49,"value":577},"\n",{"type":43,"tag":215,"props":579,"children":580},{"class":217,"line":431},[581],{"type":43,"tag":215,"props":582,"children":583},{},[584],{"type":49,"value":585},"w = WorkspaceClient()\n",{"type":43,"tag":215,"props":587,"children":588},{"class":217,"line":444},[589],{"type":43,"tag":215,"props":590,"children":591},{"emptyLinePlaceholder":574},[592],{"type":49,"value":577},{"type":43,"tag":215,"props":594,"children":595},{"class":217,"line":473},[596],{"type":43,"tag":215,"props":597,"children":598},{},[599],{"type":49,"value":600},"job = w.jobs.create(\n",{"type":43,"tag":215,"props":602,"children":603},{"class":217,"line":486},[604],{"type":43,"tag":215,"props":605,"children":606},{},[607],{"type":49,"value":608},"    name=\"my-etl-job\",\n",{"type":43,"tag":215,"props":610,"children":611},{"class":217,"line":509},[612],{"type":43,"tag":215,"props":613,"children":614},{},[615],{"type":49,"value":616},"    tasks=[\n",{"type":43,"tag":215,"props":618,"children":619},{"class":217,"line":522},[620],{"type":43,"tag":215,"props":621,"children":622},{},[623],{"type":49,"value":624},"        Task(\n",{"type":43,"tag":215,"props":626,"children":628},{"class":217,"line":627},10,[629],{"type":43,"tag":215,"props":630,"children":631},{},[632],{"type":49,"value":633},"            task_key=\"extract\",\n",{"type":43,"tag":215,"props":635,"children":637},{"class":217,"line":636},11,[638],{"type":43,"tag":215,"props":639,"children":640},{},[641],{"type":49,"value":642},"            notebook_task=NotebookTask(\n",{"type":43,"tag":215,"props":644,"children":646},{"class":217,"line":645},12,[647],{"type":43,"tag":215,"props":648,"children":649},{},[650],{"type":49,"value":651},"                notebook_path=\"\u002FWorkspace\u002FShared\u002Fetl\u002Fextract\",\n",{"type":43,"tag":215,"props":653,"children":655},{"class":217,"line":654},13,[656],{"type":43,"tag":215,"props":657,"children":658},{},[659],{"type":49,"value":660},"                source=Source.WORKSPACE,\n",{"type":43,"tag":215,"props":662,"children":664},{"class":217,"line":663},14,[665],{"type":43,"tag":215,"props":666,"children":667},{},[668],{"type":49,"value":669},"            ),\n",{"type":43,"tag":215,"props":671,"children":673},{"class":217,"line":672},15,[674],{"type":43,"tag":215,"props":675,"children":676},{},[677],{"type":49,"value":678},"        ),\n",{"type":43,"tag":215,"props":680,"children":682},{"class":217,"line":681},16,[683],{"type":43,"tag":215,"props":684,"children":685},{},[686],{"type":49,"value":687},"    ],\n",{"type":43,"tag":215,"props":689,"children":691},{"class":217,"line":690},17,[692],{"type":43,"tag":215,"props":693,"children":694},{},[695],{"type":49,"value":696},")\n",{"type":43,"tag":215,"props":698,"children":700},{"class":217,"line":699},18,[701],{"type":43,"tag":215,"props":702,"children":703},{},[704],{"type":49,"value":705},"print(f\"Created job: {job.job_id}\")\n",{"type":43,"tag":377,"props":707,"children":709},{"id":708},"cli",[710],{"type":49,"value":711},"CLI",{"type":43,"tag":204,"props":713,"children":715},{"className":206,"code":714,"language":208,"meta":209,"style":209},"databricks jobs create --json '{\n  \"name\": \"my-etl-job\",\n  \"tasks\": [{\n    \"task_key\": \"extract\",\n    \"notebook_task\": {\n      \"notebook_path\": \"\u002FWorkspace\u002FShared\u002Fetl\u002Fextract\",\n      \"source\": \"WORKSPACE\"\n    }\n  }]\n}'\n",[716],{"type":43,"tag":64,"props":717,"children":718},{"__ignoreMap":209},[719,750,758,766,774,782,790,798,806,814],{"type":43,"tag":215,"props":720,"children":721},{"class":217,"line":218},[722,726,731,736,741,745],{"type":43,"tag":215,"props":723,"children":724},{"style":222},[725],{"type":49,"value":8},{"type":43,"tag":215,"props":727,"children":728},{"style":227},[729],{"type":49,"value":730}," jobs",{"type":43,"tag":215,"props":732,"children":733},{"style":227},[734],{"type":49,"value":735}," create",{"type":43,"tag":215,"props":737,"children":738},{"style":227},[739],{"type":49,"value":740}," --json",{"type":43,"tag":215,"props":742,"children":743},{"style":248},[744],{"type":49,"value":262},{"type":43,"tag":215,"props":746,"children":747},{"style":227},[748],{"type":49,"value":749},"{\n",{"type":43,"tag":215,"props":751,"children":752},{"class":217,"line":403},[753],{"type":43,"tag":215,"props":754,"children":755},{"style":227},[756],{"type":49,"value":757},"  \"name\": \"my-etl-job\",\n",{"type":43,"tag":215,"props":759,"children":760},{"class":217,"line":418},[761],{"type":43,"tag":215,"props":762,"children":763},{"style":227},[764],{"type":49,"value":765},"  \"tasks\": [{\n",{"type":43,"tag":215,"props":767,"children":768},{"class":217,"line":431},[769],{"type":43,"tag":215,"props":770,"children":771},{"style":227},[772],{"type":49,"value":773},"    \"task_key\": \"extract\",\n",{"type":43,"tag":215,"props":775,"children":776},{"class":217,"line":444},[777],{"type":43,"tag":215,"props":778,"children":779},{"style":227},[780],{"type":49,"value":781},"    \"notebook_task\": {\n",{"type":43,"tag":215,"props":783,"children":784},{"class":217,"line":473},[785],{"type":43,"tag":215,"props":786,"children":787},{"style":227},[788],{"type":49,"value":789},"      \"notebook_path\": \"\u002FWorkspace\u002FShared\u002Fetl\u002Fextract\",\n",{"type":43,"tag":215,"props":791,"children":792},{"class":217,"line":486},[793],{"type":43,"tag":215,"props":794,"children":795},{"style":227},[796],{"type":49,"value":797},"      \"source\": \"WORKSPACE\"\n",{"type":43,"tag":215,"props":799,"children":800},{"class":217,"line":509},[801],{"type":43,"tag":215,"props":802,"children":803},{"style":227},[804],{"type":49,"value":805},"    }\n",{"type":43,"tag":215,"props":807,"children":808},{"class":217,"line":522},[809],{"type":43,"tag":215,"props":810,"children":811},{"style":227},[812],{"type":49,"value":813},"  }]\n",{"type":43,"tag":215,"props":815,"children":816},{"class":217,"line":627},[817,822],{"type":43,"tag":215,"props":818,"children":819},{"style":227},[820],{"type":49,"value":821},"}",{"type":43,"tag":215,"props":823,"children":824},{"style":248},[825],{"type":49,"value":826},"'\n",{"type":43,"tag":77,"props":828,"children":830},{"id":829},"core-concepts",[831],{"type":49,"value":832},"Core Concepts",{"type":43,"tag":377,"props":834,"children":836},{"id":835},"multi-task-workflows",[837],{"type":49,"value":838},"Multi-Task Workflows",{"type":43,"tag":52,"props":840,"children":841},{},[842],{"type":49,"value":843},"Jobs support DAG-based task dependencies:",{"type":43,"tag":204,"props":845,"children":847},{"className":385,"code":846,"language":387,"meta":209,"style":209},"tasks:\n  - task_key: extract\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fextract.py\n\n  - task_key: transform\n    depends_on:\n      - task_key: extract\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Ftransform.py\n\n  - task_key: load\n    depends_on:\n      - task_key: transform\n    run_if: ALL_SUCCESS  # Only run if all dependencies succeed\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fload.py\n",[848],{"type":43,"tag":64,"props":849,"children":850},{"__ignoreMap":209},[851,863,883,895,912,919,939,951,971,982,998,1005,1025,1036,1055,1077,1088],{"type":43,"tag":215,"props":852,"children":853},{"class":217,"line":218},[854,859],{"type":43,"tag":215,"props":855,"children":856},{"style":407},[857],{"type":49,"value":858},"tasks",{"type":43,"tag":215,"props":860,"children":861},{"style":248},[862],{"type":49,"value":415},{"type":43,"tag":215,"props":864,"children":865},{"class":217,"line":403},[866,871,875,879],{"type":43,"tag":215,"props":867,"children":868},{"style":248},[869],{"type":49,"value":870},"  -",{"type":43,"tag":215,"props":872,"children":873},{"style":407},[874],{"type":49,"value":497},{"type":43,"tag":215,"props":876,"children":877},{"style":248},[878],{"type":49,"value":455},{"type":43,"tag":215,"props":880,"children":881},{"style":227},[882],{"type":49,"value":506},{"type":43,"tag":215,"props":884,"children":885},{"class":217,"line":418},[886,891],{"type":43,"tag":215,"props":887,"children":888},{"style":407},[889],{"type":49,"value":890},"    notebook_task",{"type":43,"tag":215,"props":892,"children":893},{"style":248},[894],{"type":49,"value":415},{"type":43,"tag":215,"props":896,"children":897},{"class":217,"line":431},[898,903,907],{"type":43,"tag":215,"props":899,"children":900},{"style":407},[901],{"type":49,"value":902},"      notebook_path",{"type":43,"tag":215,"props":904,"children":905},{"style":248},[906],{"type":49,"value":455},{"type":43,"tag":215,"props":908,"children":909},{"style":227},[910],{"type":49,"value":911}," ..\u002Fsrc\u002Fextract.py\n",{"type":43,"tag":215,"props":913,"children":914},{"class":217,"line":444},[915],{"type":43,"tag":215,"props":916,"children":917},{"emptyLinePlaceholder":574},[918],{"type":49,"value":577},{"type":43,"tag":215,"props":920,"children":921},{"class":217,"line":473},[922,926,930,934],{"type":43,"tag":215,"props":923,"children":924},{"style":248},[925],{"type":49,"value":870},{"type":43,"tag":215,"props":927,"children":928},{"style":407},[929],{"type":49,"value":497},{"type":43,"tag":215,"props":931,"children":932},{"style":248},[933],{"type":49,"value":455},{"type":43,"tag":215,"props":935,"children":936},{"style":227},[937],{"type":49,"value":938}," transform\n",{"type":43,"tag":215,"props":940,"children":941},{"class":217,"line":486},[942,947],{"type":43,"tag":215,"props":943,"children":944},{"style":407},[945],{"type":49,"value":946},"    depends_on",{"type":43,"tag":215,"props":948,"children":949},{"style":248},[950],{"type":49,"value":415},{"type":43,"tag":215,"props":952,"children":953},{"class":217,"line":509},[954,959,963,967],{"type":43,"tag":215,"props":955,"children":956},{"style":248},[957],{"type":49,"value":958},"      -",{"type":43,"tag":215,"props":960,"children":961},{"style":407},[962],{"type":49,"value":497},{"type":43,"tag":215,"props":964,"children":965},{"style":248},[966],{"type":49,"value":455},{"type":43,"tag":215,"props":968,"children":969},{"style":227},[970],{"type":49,"value":506},{"type":43,"tag":215,"props":972,"children":973},{"class":217,"line":522},[974,978],{"type":43,"tag":215,"props":975,"children":976},{"style":407},[977],{"type":49,"value":890},{"type":43,"tag":215,"props":979,"children":980},{"style":248},[981],{"type":49,"value":415},{"type":43,"tag":215,"props":983,"children":984},{"class":217,"line":627},[985,989,993],{"type":43,"tag":215,"props":986,"children":987},{"style":407},[988],{"type":49,"value":902},{"type":43,"tag":215,"props":990,"children":991},{"style":248},[992],{"type":49,"value":455},{"type":43,"tag":215,"props":994,"children":995},{"style":227},[996],{"type":49,"value":997}," ..\u002Fsrc\u002Ftransform.py\n",{"type":43,"tag":215,"props":999,"children":1000},{"class":217,"line":636},[1001],{"type":43,"tag":215,"props":1002,"children":1003},{"emptyLinePlaceholder":574},[1004],{"type":49,"value":577},{"type":43,"tag":215,"props":1006,"children":1007},{"class":217,"line":645},[1008,1012,1016,1020],{"type":43,"tag":215,"props":1009,"children":1010},{"style":248},[1011],{"type":49,"value":870},{"type":43,"tag":215,"props":1013,"children":1014},{"style":407},[1015],{"type":49,"value":497},{"type":43,"tag":215,"props":1017,"children":1018},{"style":248},[1019],{"type":49,"value":455},{"type":43,"tag":215,"props":1021,"children":1022},{"style":227},[1023],{"type":49,"value":1024}," load\n",{"type":43,"tag":215,"props":1026,"children":1027},{"class":217,"line":654},[1028,1032],{"type":43,"tag":215,"props":1029,"children":1030},{"style":407},[1031],{"type":49,"value":946},{"type":43,"tag":215,"props":1033,"children":1034},{"style":248},[1035],{"type":49,"value":415},{"type":43,"tag":215,"props":1037,"children":1038},{"class":217,"line":663},[1039,1043,1047,1051],{"type":43,"tag":215,"props":1040,"children":1041},{"style":248},[1042],{"type":49,"value":958},{"type":43,"tag":215,"props":1044,"children":1045},{"style":407},[1046],{"type":49,"value":497},{"type":43,"tag":215,"props":1048,"children":1049},{"style":248},[1050],{"type":49,"value":455},{"type":43,"tag":215,"props":1052,"children":1053},{"style":227},[1054],{"type":49,"value":938},{"type":43,"tag":215,"props":1056,"children":1057},{"class":217,"line":672},[1058,1063,1067,1072],{"type":43,"tag":215,"props":1059,"children":1060},{"style":407},[1061],{"type":49,"value":1062},"    run_if",{"type":43,"tag":215,"props":1064,"children":1065},{"style":248},[1066],{"type":49,"value":455},{"type":43,"tag":215,"props":1068,"children":1069},{"style":227},[1070],{"type":49,"value":1071}," ALL_SUCCESS",{"type":43,"tag":215,"props":1073,"children":1074},{"style":397},[1075],{"type":49,"value":1076},"  # Only run if all dependencies succeed\n",{"type":43,"tag":215,"props":1078,"children":1079},{"class":217,"line":681},[1080,1084],{"type":43,"tag":215,"props":1081,"children":1082},{"style":407},[1083],{"type":49,"value":890},{"type":43,"tag":215,"props":1085,"children":1086},{"style":248},[1087],{"type":49,"value":415},{"type":43,"tag":215,"props":1089,"children":1090},{"class":217,"line":690},[1091,1095,1099],{"type":43,"tag":215,"props":1092,"children":1093},{"style":407},[1094],{"type":49,"value":902},{"type":43,"tag":215,"props":1096,"children":1097},{"style":248},[1098],{"type":49,"value":455},{"type":43,"tag":215,"props":1100,"children":1101},{"style":227},[1102],{"type":49,"value":1103}," ..\u002Fsrc\u002Fload.py\n",{"type":43,"tag":52,"props":1105,"children":1106},{},[1107],{"type":43,"tag":56,"props":1108,"children":1109},{},[1110],{"type":49,"value":1111},"run_if conditions:",{"type":43,"tag":309,"props":1113,"children":1114},{},[1115,1126,1137,1148,1159,1170],{"type":43,"tag":313,"props":1116,"children":1117},{},[1118,1124],{"type":43,"tag":64,"props":1119,"children":1121},{"className":1120},[],[1122],{"type":49,"value":1123},"ALL_SUCCESS",{"type":49,"value":1125}," (default) — run when all dependencies succeed",{"type":43,"tag":313,"props":1127,"children":1128},{},[1129,1135],{"type":43,"tag":64,"props":1130,"children":1132},{"className":1131},[],[1133],{"type":49,"value":1134},"ALL_DONE",{"type":49,"value":1136}," — run when all dependencies complete (success or failure)",{"type":43,"tag":313,"props":1138,"children":1139},{},[1140,1146],{"type":43,"tag":64,"props":1141,"children":1143},{"className":1142},[],[1144],{"type":49,"value":1145},"AT_LEAST_ONE_SUCCESS",{"type":49,"value":1147}," — run when at least one dependency succeeds",{"type":43,"tag":313,"props":1149,"children":1150},{},[1151,1157],{"type":43,"tag":64,"props":1152,"children":1154},{"className":1153},[],[1155],{"type":49,"value":1156},"NONE_FAILED",{"type":49,"value":1158}," — run when no dependencies failed",{"type":43,"tag":313,"props":1160,"children":1161},{},[1162,1168],{"type":43,"tag":64,"props":1163,"children":1165},{"className":1164},[],[1166],{"type":49,"value":1167},"ALL_FAILED",{"type":49,"value":1169}," — run when all dependencies failed",{"type":43,"tag":313,"props":1171,"children":1172},{},[1173,1179],{"type":43,"tag":64,"props":1174,"children":1176},{"className":1175},[],[1177],{"type":49,"value":1178},"AT_LEAST_ONE_FAILED",{"type":49,"value":1180}," — run when at least one dependency failed",{"type":43,"tag":377,"props":1182,"children":1184},{"id":1183},"task-types-summary",[1185],{"type":49,"value":1186},"Task Types Summary",{"type":43,"tag":84,"props":1188,"children":1189},{},[1190,1210],{"type":43,"tag":88,"props":1191,"children":1192},{},[1193],{"type":43,"tag":92,"props":1194,"children":1195},{},[1196,1201,1205],{"type":43,"tag":96,"props":1197,"children":1198},{},[1199],{"type":49,"value":1200},"Task Type",{"type":43,"tag":96,"props":1202,"children":1203},{},[1204],{"type":49,"value":100},{"type":43,"tag":96,"props":1206,"children":1207},{},[1208],{"type":49,"value":1209},"Reference",{"type":43,"tag":107,"props":1211,"children":1212},{},[1213,1238,1263,1288,1313,1338,1363,1388,1413],{"type":43,"tag":92,"props":1214,"children":1215},{},[1216,1225,1230],{"type":43,"tag":114,"props":1217,"children":1218},{},[1219],{"type":43,"tag":64,"props":1220,"children":1222},{"className":1221},[],[1223],{"type":49,"value":1224},"notebook_task",{"type":43,"tag":114,"props":1226,"children":1227},{},[1228],{"type":49,"value":1229},"Run notebooks",{"type":43,"tag":114,"props":1231,"children":1232},{},[1233],{"type":43,"tag":123,"props":1234,"children":1236},{"href":1235},"references\u002Ftask-types.md#notebook-task",[1237],{"type":49,"value":1235},{"type":43,"tag":92,"props":1239,"children":1240},{},[1241,1250,1255],{"type":43,"tag":114,"props":1242,"children":1243},{},[1244],{"type":43,"tag":64,"props":1245,"children":1247},{"className":1246},[],[1248],{"type":49,"value":1249},"spark_python_task",{"type":43,"tag":114,"props":1251,"children":1252},{},[1253],{"type":49,"value":1254},"Run Python scripts",{"type":43,"tag":114,"props":1256,"children":1257},{},[1258],{"type":43,"tag":123,"props":1259,"children":1261},{"href":1260},"references\u002Ftask-types.md#spark-python-task",[1262],{"type":49,"value":1260},{"type":43,"tag":92,"props":1264,"children":1265},{},[1266,1275,1280],{"type":43,"tag":114,"props":1267,"children":1268},{},[1269],{"type":43,"tag":64,"props":1270,"children":1272},{"className":1271},[],[1273],{"type":49,"value":1274},"python_wheel_task",{"type":43,"tag":114,"props":1276,"children":1277},{},[1278],{"type":49,"value":1279},"Run Python wheels",{"type":43,"tag":114,"props":1281,"children":1282},{},[1283],{"type":43,"tag":123,"props":1284,"children":1286},{"href":1285},"references\u002Ftask-types.md#python-wheel-task",[1287],{"type":49,"value":1285},{"type":43,"tag":92,"props":1289,"children":1290},{},[1291,1300,1305],{"type":43,"tag":114,"props":1292,"children":1293},{},[1294],{"type":43,"tag":64,"props":1295,"children":1297},{"className":1296},[],[1298],{"type":49,"value":1299},"sql_task",{"type":43,"tag":114,"props":1301,"children":1302},{},[1303],{"type":49,"value":1304},"Run SQL queries\u002Ffiles\u002Fdashboards\u002Falerts",{"type":43,"tag":114,"props":1306,"children":1307},{},[1308],{"type":43,"tag":123,"props":1309,"children":1311},{"href":1310},"references\u002Ftask-types.md#sql-task",[1312],{"type":49,"value":1310},{"type":43,"tag":92,"props":1314,"children":1315},{},[1316,1325,1330],{"type":43,"tag":114,"props":1317,"children":1318},{},[1319],{"type":43,"tag":64,"props":1320,"children":1322},{"className":1321},[],[1323],{"type":49,"value":1324},"dbt_task",{"type":43,"tag":114,"props":1326,"children":1327},{},[1328],{"type":49,"value":1329},"Run dbt projects",{"type":43,"tag":114,"props":1331,"children":1332},{},[1333],{"type":43,"tag":123,"props":1334,"children":1336},{"href":1335},"references\u002Ftask-types.md#dbt-task",[1337],{"type":49,"value":1335},{"type":43,"tag":92,"props":1339,"children":1340},{},[1341,1350,1355],{"type":43,"tag":114,"props":1342,"children":1343},{},[1344],{"type":43,"tag":64,"props":1345,"children":1347},{"className":1346},[],[1348],{"type":49,"value":1349},"pipeline_task",{"type":43,"tag":114,"props":1351,"children":1352},{},[1353],{"type":49,"value":1354},"Trigger SDP (formerly DLT) pipelines",{"type":43,"tag":114,"props":1356,"children":1357},{},[1358],{"type":43,"tag":123,"props":1359,"children":1361},{"href":1360},"references\u002Ftask-types.md#pipeline-task",[1362],{"type":49,"value":1360},{"type":43,"tag":92,"props":1364,"children":1365},{},[1366,1375,1380],{"type":43,"tag":114,"props":1367,"children":1368},{},[1369],{"type":43,"tag":64,"props":1370,"children":1372},{"className":1371},[],[1373],{"type":49,"value":1374},"spark_jar_task",{"type":43,"tag":114,"props":1376,"children":1377},{},[1378],{"type":49,"value":1379},"Run Spark JARs",{"type":43,"tag":114,"props":1381,"children":1382},{},[1383],{"type":43,"tag":123,"props":1384,"children":1386},{"href":1385},"references\u002Ftask-types.md#spark-jar-task",[1387],{"type":49,"value":1385},{"type":43,"tag":92,"props":1389,"children":1390},{},[1391,1400,1405],{"type":43,"tag":114,"props":1392,"children":1393},{},[1394],{"type":43,"tag":64,"props":1395,"children":1397},{"className":1396},[],[1398],{"type":49,"value":1399},"run_job_task",{"type":43,"tag":114,"props":1401,"children":1402},{},[1403],{"type":49,"value":1404},"Trigger other jobs",{"type":43,"tag":114,"props":1406,"children":1407},{},[1408],{"type":43,"tag":123,"props":1409,"children":1411},{"href":1410},"references\u002Ftask-types.md#run-job-task",[1412],{"type":49,"value":1410},{"type":43,"tag":92,"props":1414,"children":1415},{},[1416,1425,1430],{"type":43,"tag":114,"props":1417,"children":1418},{},[1419],{"type":43,"tag":64,"props":1420,"children":1422},{"className":1421},[],[1423],{"type":49,"value":1424},"for_each_task",{"type":43,"tag":114,"props":1426,"children":1427},{},[1428],{"type":49,"value":1429},"Loop over inputs",{"type":43,"tag":114,"props":1431,"children":1432},{},[1433],{"type":43,"tag":123,"props":1434,"children":1436},{"href":1435},"references\u002Ftask-types.md#for-each-task",[1437],{"type":49,"value":1435},{"type":43,"tag":377,"props":1439,"children":1441},{"id":1440},"trigger-types-summary",[1442],{"type":49,"value":1443},"Trigger Types Summary",{"type":43,"tag":84,"props":1445,"children":1446},{},[1447,1466],{"type":43,"tag":88,"props":1448,"children":1449},{},[1450],{"type":43,"tag":92,"props":1451,"children":1452},{},[1453,1458,1462],{"type":43,"tag":96,"props":1454,"children":1455},{},[1456],{"type":49,"value":1457},"Trigger Type",{"type":43,"tag":96,"props":1459,"children":1460},{},[1461],{"type":49,"value":100},{"type":43,"tag":96,"props":1463,"children":1464},{},[1465],{"type":49,"value":1209},{"type":43,"tag":107,"props":1467,"children":1468},{},[1469,1494,1519,1544,1569],{"type":43,"tag":92,"props":1470,"children":1471},{},[1472,1481,1486],{"type":43,"tag":114,"props":1473,"children":1474},{},[1475],{"type":43,"tag":64,"props":1476,"children":1478},{"className":1477},[],[1479],{"type":49,"value":1480},"schedule",{"type":43,"tag":114,"props":1482,"children":1483},{},[1484],{"type":49,"value":1485},"Cron-based scheduling",{"type":43,"tag":114,"props":1487,"children":1488},{},[1489],{"type":43,"tag":123,"props":1490,"children":1492},{"href":1491},"references\u002Ftriggers-schedules.md#cron-schedule",[1493],{"type":49,"value":1491},{"type":43,"tag":92,"props":1495,"children":1496},{},[1497,1506,1511],{"type":43,"tag":114,"props":1498,"children":1499},{},[1500],{"type":43,"tag":64,"props":1501,"children":1503},{"className":1502},[],[1504],{"type":49,"value":1505},"trigger.periodic",{"type":43,"tag":114,"props":1507,"children":1508},{},[1509],{"type":49,"value":1510},"Interval-based",{"type":43,"tag":114,"props":1512,"children":1513},{},[1514],{"type":43,"tag":123,"props":1515,"children":1517},{"href":1516},"references\u002Ftriggers-schedules.md#periodic-trigger",[1518],{"type":49,"value":1516},{"type":43,"tag":92,"props":1520,"children":1521},{},[1522,1531,1536],{"type":43,"tag":114,"props":1523,"children":1524},{},[1525],{"type":43,"tag":64,"props":1526,"children":1528},{"className":1527},[],[1529],{"type":49,"value":1530},"trigger.file_arrival",{"type":43,"tag":114,"props":1532,"children":1533},{},[1534],{"type":49,"value":1535},"File arrival events",{"type":43,"tag":114,"props":1537,"children":1538},{},[1539],{"type":43,"tag":123,"props":1540,"children":1542},{"href":1541},"references\u002Ftriggers-schedules.md#file-arrival-trigger",[1543],{"type":49,"value":1541},{"type":43,"tag":92,"props":1545,"children":1546},{},[1547,1556,1561],{"type":43,"tag":114,"props":1548,"children":1549},{},[1550],{"type":43,"tag":64,"props":1551,"children":1553},{"className":1552},[],[1554],{"type":49,"value":1555},"trigger.table_update",{"type":43,"tag":114,"props":1557,"children":1558},{},[1559],{"type":49,"value":1560},"Unity Catalog table change events",{"type":43,"tag":114,"props":1562,"children":1563},{},[1564],{"type":43,"tag":123,"props":1565,"children":1567},{"href":1566},"references\u002Ftriggers-schedules.md#table-update-trigger",[1568],{"type":49,"value":1566},{"type":43,"tag":92,"props":1570,"children":1571},{},[1572,1581,1586],{"type":43,"tag":114,"props":1573,"children":1574},{},[1575],{"type":43,"tag":64,"props":1576,"children":1578},{"className":1577},[],[1579],{"type":49,"value":1580},"continuous",{"type":43,"tag":114,"props":1582,"children":1583},{},[1584],{"type":49,"value":1585},"Always-running jobs",{"type":43,"tag":114,"props":1587,"children":1588},{},[1589],{"type":43,"tag":123,"props":1590,"children":1592},{"href":1591},"references\u002Ftriggers-schedules.md#continuous-jobs",[1593],{"type":49,"value":1591},{"type":43,"tag":77,"props":1595,"children":1597},{"id":1596},"compute-configuration",[1598],{"type":49,"value":1599},"Compute Configuration",{"type":43,"tag":377,"props":1601,"children":1603},{"id":1602},"job-clusters-recommended",[1604],{"type":49,"value":1605},"Job Clusters (recommended)",{"type":43,"tag":52,"props":1607,"children":1608},{},[1609],{"type":49,"value":1610},"Define reusable cluster configurations shared across tasks:",{"type":43,"tag":204,"props":1612,"children":1614},{"className":385,"code":1613,"language":387,"meta":209,"style":209},"job_clusters:\n  - job_cluster_key: shared_cluster\n    new_cluster:\n      spark_version: \"15.4.x-scala2.12\"\n      node_type_id: \"i3.xlarge\"\n      num_workers: 2\n      spark_conf:\n        spark.speculation: \"true\"\n\ntasks:\n  - task_key: my_task\n    job_cluster_key: shared_cluster\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n",[1615],{"type":43,"tag":64,"props":1616,"children":1617},{"__ignoreMap":209},[1618,1630,1651,1663,1688,1713,1731,1743,1768,1775,1786,1806,1822,1833],{"type":43,"tag":215,"props":1619,"children":1620},{"class":217,"line":218},[1621,1626],{"type":43,"tag":215,"props":1622,"children":1623},{"style":407},[1624],{"type":49,"value":1625},"job_clusters",{"type":43,"tag":215,"props":1627,"children":1628},{"style":248},[1629],{"type":49,"value":415},{"type":43,"tag":215,"props":1631,"children":1632},{"class":217,"line":403},[1633,1637,1642,1646],{"type":43,"tag":215,"props":1634,"children":1635},{"style":248},[1636],{"type":49,"value":870},{"type":43,"tag":215,"props":1638,"children":1639},{"style":407},[1640],{"type":49,"value":1641}," job_cluster_key",{"type":43,"tag":215,"props":1643,"children":1644},{"style":248},[1645],{"type":49,"value":455},{"type":43,"tag":215,"props":1647,"children":1648},{"style":227},[1649],{"type":49,"value":1650}," shared_cluster\n",{"type":43,"tag":215,"props":1652,"children":1653},{"class":217,"line":418},[1654,1659],{"type":43,"tag":215,"props":1655,"children":1656},{"style":407},[1657],{"type":49,"value":1658},"    new_cluster",{"type":43,"tag":215,"props":1660,"children":1661},{"style":248},[1662],{"type":49,"value":415},{"type":43,"tag":215,"props":1664,"children":1665},{"class":217,"line":431},[1666,1671,1675,1679,1684],{"type":43,"tag":215,"props":1667,"children":1668},{"style":407},[1669],{"type":49,"value":1670},"      spark_version",{"type":43,"tag":215,"props":1672,"children":1673},{"style":248},[1674],{"type":49,"value":455},{"type":43,"tag":215,"props":1676,"children":1677},{"style":248},[1678],{"type":49,"value":460},{"type":43,"tag":215,"props":1680,"children":1681},{"style":227},[1682],{"type":49,"value":1683},"15.4.x-scala2.12",{"type":43,"tag":215,"props":1685,"children":1686},{"style":248},[1687],{"type":49,"value":470},{"type":43,"tag":215,"props":1689,"children":1690},{"class":217,"line":444},[1691,1696,1700,1704,1709],{"type":43,"tag":215,"props":1692,"children":1693},{"style":407},[1694],{"type":49,"value":1695},"      node_type_id",{"type":43,"tag":215,"props":1697,"children":1698},{"style":248},[1699],{"type":49,"value":455},{"type":43,"tag":215,"props":1701,"children":1702},{"style":248},[1703],{"type":49,"value":460},{"type":43,"tag":215,"props":1705,"children":1706},{"style":227},[1707],{"type":49,"value":1708},"i3.xlarge",{"type":43,"tag":215,"props":1710,"children":1711},{"style":248},[1712],{"type":49,"value":470},{"type":43,"tag":215,"props":1714,"children":1715},{"class":217,"line":473},[1716,1721,1725],{"type":43,"tag":215,"props":1717,"children":1718},{"style":407},[1719],{"type":49,"value":1720},"      num_workers",{"type":43,"tag":215,"props":1722,"children":1723},{"style":248},[1724],{"type":49,"value":455},{"type":43,"tag":215,"props":1726,"children":1728},{"style":1727},"--shiki-light:#F76D47;--shiki-default:#F78C6C;--shiki-dark:#F78C6C",[1729],{"type":49,"value":1730}," 2\n",{"type":43,"tag":215,"props":1732,"children":1733},{"class":217,"line":486},[1734,1739],{"type":43,"tag":215,"props":1735,"children":1736},{"style":407},[1737],{"type":49,"value":1738},"      spark_conf",{"type":43,"tag":215,"props":1740,"children":1741},{"style":248},[1742],{"type":49,"value":415},{"type":43,"tag":215,"props":1744,"children":1745},{"class":217,"line":509},[1746,1751,1755,1759,1764],{"type":43,"tag":215,"props":1747,"children":1748},{"style":407},[1749],{"type":49,"value":1750},"        spark.speculation",{"type":43,"tag":215,"props":1752,"children":1753},{"style":248},[1754],{"type":49,"value":455},{"type":43,"tag":215,"props":1756,"children":1757},{"style":248},[1758],{"type":49,"value":460},{"type":43,"tag":215,"props":1760,"children":1761},{"style":227},[1762],{"type":49,"value":1763},"true",{"type":43,"tag":215,"props":1765,"children":1766},{"style":248},[1767],{"type":49,"value":470},{"type":43,"tag":215,"props":1769,"children":1770},{"class":217,"line":522},[1771],{"type":43,"tag":215,"props":1772,"children":1773},{"emptyLinePlaceholder":574},[1774],{"type":49,"value":577},{"type":43,"tag":215,"props":1776,"children":1777},{"class":217,"line":627},[1778,1782],{"type":43,"tag":215,"props":1779,"children":1780},{"style":407},[1781],{"type":49,"value":858},{"type":43,"tag":215,"props":1783,"children":1784},{"style":248},[1785],{"type":49,"value":415},{"type":43,"tag":215,"props":1787,"children":1788},{"class":217,"line":636},[1789,1793,1797,1801],{"type":43,"tag":215,"props":1790,"children":1791},{"style":248},[1792],{"type":49,"value":870},{"type":43,"tag":215,"props":1794,"children":1795},{"style":407},[1796],{"type":49,"value":497},{"type":43,"tag":215,"props":1798,"children":1799},{"style":248},[1800],{"type":49,"value":455},{"type":43,"tag":215,"props":1802,"children":1803},{"style":227},[1804],{"type":49,"value":1805}," my_task\n",{"type":43,"tag":215,"props":1807,"children":1808},{"class":217,"line":645},[1809,1814,1818],{"type":43,"tag":215,"props":1810,"children":1811},{"style":407},[1812],{"type":49,"value":1813},"    job_cluster_key",{"type":43,"tag":215,"props":1815,"children":1816},{"style":248},[1817],{"type":49,"value":455},{"type":43,"tag":215,"props":1819,"children":1820},{"style":227},[1821],{"type":49,"value":1650},{"type":43,"tag":215,"props":1823,"children":1824},{"class":217,"line":654},[1825,1829],{"type":43,"tag":215,"props":1826,"children":1827},{"style":407},[1828],{"type":49,"value":890},{"type":43,"tag":215,"props":1830,"children":1831},{"style":248},[1832],{"type":49,"value":415},{"type":43,"tag":215,"props":1834,"children":1835},{"class":217,"line":663},[1836,1840,1844],{"type":43,"tag":215,"props":1837,"children":1838},{"style":407},[1839],{"type":49,"value":902},{"type":43,"tag":215,"props":1841,"children":1842},{"style":248},[1843],{"type":49,"value":455},{"type":43,"tag":215,"props":1845,"children":1846},{"style":227},[1847],{"type":49,"value":1848}," ..\u002Fsrc\u002Fnotebook.py\n",{"type":43,"tag":377,"props":1850,"children":1852},{"id":1851},"autoscaling-clusters",[1853],{"type":49,"value":1854},"Autoscaling Clusters",{"type":43,"tag":204,"props":1856,"children":1858},{"className":385,"code":1857,"language":387,"meta":209,"style":209},"new_cluster:\n  spark_version: \"15.4.x-scala2.12\"\n  node_type_id: \"i3.xlarge\"\n  autoscale:\n    min_workers: 2\n    max_workers: 8\n",[1859],{"type":43,"tag":64,"props":1860,"children":1861},{"__ignoreMap":209},[1862,1874,1898,1922,1934,1950],{"type":43,"tag":215,"props":1863,"children":1864},{"class":217,"line":218},[1865,1870],{"type":43,"tag":215,"props":1866,"children":1867},{"style":407},[1868],{"type":49,"value":1869},"new_cluster",{"type":43,"tag":215,"props":1871,"children":1872},{"style":248},[1873],{"type":49,"value":415},{"type":43,"tag":215,"props":1875,"children":1876},{"class":217,"line":403},[1877,1882,1886,1890,1894],{"type":43,"tag":215,"props":1878,"children":1879},{"style":407},[1880],{"type":49,"value":1881},"  spark_version",{"type":43,"tag":215,"props":1883,"children":1884},{"style":248},[1885],{"type":49,"value":455},{"type":43,"tag":215,"props":1887,"children":1888},{"style":248},[1889],{"type":49,"value":460},{"type":43,"tag":215,"props":1891,"children":1892},{"style":227},[1893],{"type":49,"value":1683},{"type":43,"tag":215,"props":1895,"children":1896},{"style":248},[1897],{"type":49,"value":470},{"type":43,"tag":215,"props":1899,"children":1900},{"class":217,"line":418},[1901,1906,1910,1914,1918],{"type":43,"tag":215,"props":1902,"children":1903},{"style":407},[1904],{"type":49,"value":1905},"  node_type_id",{"type":43,"tag":215,"props":1907,"children":1908},{"style":248},[1909],{"type":49,"value":455},{"type":43,"tag":215,"props":1911,"children":1912},{"style":248},[1913],{"type":49,"value":460},{"type":43,"tag":215,"props":1915,"children":1916},{"style":227},[1917],{"type":49,"value":1708},{"type":43,"tag":215,"props":1919,"children":1920},{"style":248},[1921],{"type":49,"value":470},{"type":43,"tag":215,"props":1923,"children":1924},{"class":217,"line":431},[1925,1930],{"type":43,"tag":215,"props":1926,"children":1927},{"style":407},[1928],{"type":49,"value":1929},"  autoscale",{"type":43,"tag":215,"props":1931,"children":1932},{"style":248},[1933],{"type":49,"value":415},{"type":43,"tag":215,"props":1935,"children":1936},{"class":217,"line":444},[1937,1942,1946],{"type":43,"tag":215,"props":1938,"children":1939},{"style":407},[1940],{"type":49,"value":1941},"    min_workers",{"type":43,"tag":215,"props":1943,"children":1944},{"style":248},[1945],{"type":49,"value":455},{"type":43,"tag":215,"props":1947,"children":1948},{"style":1727},[1949],{"type":49,"value":1730},{"type":43,"tag":215,"props":1951,"children":1952},{"class":217,"line":473},[1953,1958,1962],{"type":43,"tag":215,"props":1954,"children":1955},{"style":407},[1956],{"type":49,"value":1957},"    max_workers",{"type":43,"tag":215,"props":1959,"children":1960},{"style":248},[1961],{"type":49,"value":455},{"type":43,"tag":215,"props":1963,"children":1964},{"style":1727},[1965],{"type":49,"value":1966}," 8\n",{"type":43,"tag":377,"props":1968,"children":1970},{"id":1969},"existing-cluster",[1971],{"type":49,"value":1972},"Existing Cluster",{"type":43,"tag":204,"props":1974,"children":1976},{"className":385,"code":1975,"language":387,"meta":209,"style":209},"tasks:\n  - task_key: my_task\n    existing_cluster_id: \"0123-456789-abcdef12\"\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n",[1977],{"type":43,"tag":64,"props":1978,"children":1979},{"__ignoreMap":209},[1980,1991,2010,2035,2046],{"type":43,"tag":215,"props":1981,"children":1982},{"class":217,"line":218},[1983,1987],{"type":43,"tag":215,"props":1984,"children":1985},{"style":407},[1986],{"type":49,"value":858},{"type":43,"tag":215,"props":1988,"children":1989},{"style":248},[1990],{"type":49,"value":415},{"type":43,"tag":215,"props":1992,"children":1993},{"class":217,"line":403},[1994,1998,2002,2006],{"type":43,"tag":215,"props":1995,"children":1996},{"style":248},[1997],{"type":49,"value":870},{"type":43,"tag":215,"props":1999,"children":2000},{"style":407},[2001],{"type":49,"value":497},{"type":43,"tag":215,"props":2003,"children":2004},{"style":248},[2005],{"type":49,"value":455},{"type":43,"tag":215,"props":2007,"children":2008},{"style":227},[2009],{"type":49,"value":1805},{"type":43,"tag":215,"props":2011,"children":2012},{"class":217,"line":418},[2013,2018,2022,2026,2031],{"type":43,"tag":215,"props":2014,"children":2015},{"style":407},[2016],{"type":49,"value":2017},"    existing_cluster_id",{"type":43,"tag":215,"props":2019,"children":2020},{"style":248},[2021],{"type":49,"value":455},{"type":43,"tag":215,"props":2023,"children":2024},{"style":248},[2025],{"type":49,"value":460},{"type":43,"tag":215,"props":2027,"children":2028},{"style":227},[2029],{"type":49,"value":2030},"0123-456789-abcdef12",{"type":43,"tag":215,"props":2032,"children":2033},{"style":248},[2034],{"type":49,"value":470},{"type":43,"tag":215,"props":2036,"children":2037},{"class":217,"line":431},[2038,2042],{"type":43,"tag":215,"props":2039,"children":2040},{"style":407},[2041],{"type":49,"value":890},{"type":43,"tag":215,"props":2043,"children":2044},{"style":248},[2045],{"type":49,"value":415},{"type":43,"tag":215,"props":2047,"children":2048},{"class":217,"line":444},[2049,2053,2057],{"type":43,"tag":215,"props":2050,"children":2051},{"style":407},[2052],{"type":49,"value":902},{"type":43,"tag":215,"props":2054,"children":2055},{"style":248},[2056],{"type":49,"value":455},{"type":43,"tag":215,"props":2058,"children":2059},{"style":227},[2060],{"type":49,"value":1848},{"type":43,"tag":377,"props":2062,"children":2064},{"id":2063},"serverless-compute",[2065],{"type":49,"value":2066},"Serverless Compute",{"type":43,"tag":52,"props":2068,"children":2069},{},[2070],{"type":49,"value":2071},"For notebook and Python tasks, omit cluster configuration to use serverless:",{"type":43,"tag":204,"props":2073,"children":2075},{"className":385,"code":2074,"language":387,"meta":209,"style":209},"tasks:\n  - task_key: serverless_task\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n    # No cluster config = serverless\n",[2076],{"type":43,"tag":64,"props":2077,"children":2078},{"__ignoreMap":209},[2079,2090,2110,2121,2136],{"type":43,"tag":215,"props":2080,"children":2081},{"class":217,"line":218},[2082,2086],{"type":43,"tag":215,"props":2083,"children":2084},{"style":407},[2085],{"type":49,"value":858},{"type":43,"tag":215,"props":2087,"children":2088},{"style":248},[2089],{"type":49,"value":415},{"type":43,"tag":215,"props":2091,"children":2092},{"class":217,"line":403},[2093,2097,2101,2105],{"type":43,"tag":215,"props":2094,"children":2095},{"style":248},[2096],{"type":49,"value":870},{"type":43,"tag":215,"props":2098,"children":2099},{"style":407},[2100],{"type":49,"value":497},{"type":43,"tag":215,"props":2102,"children":2103},{"style":248},[2104],{"type":49,"value":455},{"type":43,"tag":215,"props":2106,"children":2107},{"style":227},[2108],{"type":49,"value":2109}," serverless_task\n",{"type":43,"tag":215,"props":2111,"children":2112},{"class":217,"line":418},[2113,2117],{"type":43,"tag":215,"props":2114,"children":2115},{"style":407},[2116],{"type":49,"value":890},{"type":43,"tag":215,"props":2118,"children":2119},{"style":248},[2120],{"type":49,"value":415},{"type":43,"tag":215,"props":2122,"children":2123},{"class":217,"line":431},[2124,2128,2132],{"type":43,"tag":215,"props":2125,"children":2126},{"style":407},[2127],{"type":49,"value":902},{"type":43,"tag":215,"props":2129,"children":2130},{"style":248},[2131],{"type":49,"value":455},{"type":43,"tag":215,"props":2133,"children":2134},{"style":227},[2135],{"type":49,"value":1848},{"type":43,"tag":215,"props":2137,"children":2138},{"class":217,"line":444},[2139],{"type":43,"tag":215,"props":2140,"children":2141},{"style":397},[2142],{"type":49,"value":2143},"    # No cluster config = serverless\n",{"type":43,"tag":77,"props":2145,"children":2147},{"id":2146},"job-parameters",[2148],{"type":49,"value":2149},"Job Parameters",{"type":43,"tag":52,"props":2151,"children":2152},{},[2153],{"type":49,"value":2154},"Parameters defined at job level are passed to ALL tasks (no need to repeat per task):",{"type":43,"tag":204,"props":2156,"children":2158},{"className":385,"code":2157,"language":387,"meta":209,"style":209},"parameters:\n  - name: env\n    default: \"dev\"\n  - name: date\n    default: \"{{start_date}}\"  # Dynamic value reference\n",[2159],{"type":43,"tag":64,"props":2160,"children":2161},{"__ignoreMap":209},[2162,2174,2195,2220,2240],{"type":43,"tag":215,"props":2163,"children":2164},{"class":217,"line":218},[2165,2170],{"type":43,"tag":215,"props":2166,"children":2167},{"style":407},[2168],{"type":49,"value":2169},"parameters",{"type":43,"tag":215,"props":2171,"children":2172},{"style":248},[2173],{"type":49,"value":415},{"type":43,"tag":215,"props":2175,"children":2176},{"class":217,"line":403},[2177,2181,2186,2190],{"type":43,"tag":215,"props":2178,"children":2179},{"style":248},[2180],{"type":49,"value":870},{"type":43,"tag":215,"props":2182,"children":2183},{"style":407},[2184],{"type":49,"value":2185}," name",{"type":43,"tag":215,"props":2187,"children":2188},{"style":248},[2189],{"type":49,"value":455},{"type":43,"tag":215,"props":2191,"children":2192},{"style":227},[2193],{"type":49,"value":2194}," env\n",{"type":43,"tag":215,"props":2196,"children":2197},{"class":217,"line":418},[2198,2203,2207,2211,2216],{"type":43,"tag":215,"props":2199,"children":2200},{"style":407},[2201],{"type":49,"value":2202},"    default",{"type":43,"tag":215,"props":2204,"children":2205},{"style":248},[2206],{"type":49,"value":455},{"type":43,"tag":215,"props":2208,"children":2209},{"style":248},[2210],{"type":49,"value":460},{"type":43,"tag":215,"props":2212,"children":2213},{"style":227},[2214],{"type":49,"value":2215},"dev",{"type":43,"tag":215,"props":2217,"children":2218},{"style":248},[2219],{"type":49,"value":470},{"type":43,"tag":215,"props":2221,"children":2222},{"class":217,"line":431},[2223,2227,2231,2235],{"type":43,"tag":215,"props":2224,"children":2225},{"style":248},[2226],{"type":49,"value":870},{"type":43,"tag":215,"props":2228,"children":2229},{"style":407},[2230],{"type":49,"value":2185},{"type":43,"tag":215,"props":2232,"children":2233},{"style":248},[2234],{"type":49,"value":455},{"type":43,"tag":215,"props":2236,"children":2237},{"style":227},[2238],{"type":49,"value":2239}," date\n",{"type":43,"tag":215,"props":2241,"children":2242},{"class":217,"line":444},[2243,2247,2251,2255,2260,2265],{"type":43,"tag":215,"props":2244,"children":2245},{"style":407},[2246],{"type":49,"value":2202},{"type":43,"tag":215,"props":2248,"children":2249},{"style":248},[2250],{"type":49,"value":455},{"type":43,"tag":215,"props":2252,"children":2253},{"style":248},[2254],{"type":49,"value":460},{"type":43,"tag":215,"props":2256,"children":2257},{"style":227},[2258],{"type":49,"value":2259},"{{start_date}}",{"type":43,"tag":215,"props":2261,"children":2262},{"style":248},[2263],{"type":49,"value":2264},"\"",{"type":43,"tag":215,"props":2266,"children":2267},{"style":397},[2268],{"type":49,"value":2269},"  # Dynamic value reference\n",{"type":43,"tag":52,"props":2271,"children":2272},{},[2273],{"type":49,"value":2274},"Access in notebooks:",{"type":43,"tag":204,"props":2276,"children":2278},{"className":546,"code":2277,"language":548,"meta":209,"style":209},"catalog = dbutils.widgets.get(\"env\")\nload_date = dbutils.widgets.get(\"date\")\n",[2279],{"type":43,"tag":64,"props":2280,"children":2281},{"__ignoreMap":209},[2282,2290],{"type":43,"tag":215,"props":2283,"children":2284},{"class":217,"line":218},[2285],{"type":43,"tag":215,"props":2286,"children":2287},{},[2288],{"type":49,"value":2289},"catalog = dbutils.widgets.get(\"env\")\n",{"type":43,"tag":215,"props":2291,"children":2292},{"class":217,"line":403},[2293],{"type":43,"tag":215,"props":2294,"children":2295},{},[2296],{"type":49,"value":2297},"load_date = dbutils.widgets.get(\"date\")\n",{"type":43,"tag":52,"props":2299,"children":2300},{},[2301],{"type":49,"value":2302},"Pass to specific tasks:",{"type":43,"tag":204,"props":2304,"children":2306},{"className":385,"code":2305,"language":387,"meta":209,"style":209},"tasks:\n  - task_key: my_task\n    notebook_task:\n      notebook_path: ..\u002Fsrc\u002Fnotebook.py\n      base_parameters:\n        env: \"{{job.parameters.env}}\"\n        custom_param: \"value\"\n",[2307],{"type":43,"tag":64,"props":2308,"children":2309},{"__ignoreMap":209},[2310,2321,2340,2351,2366,2378,2403],{"type":43,"tag":215,"props":2311,"children":2312},{"class":217,"line":218},[2313,2317],{"type":43,"tag":215,"props":2314,"children":2315},{"style":407},[2316],{"type":49,"value":858},{"type":43,"tag":215,"props":2318,"children":2319},{"style":248},[2320],{"type":49,"value":415},{"type":43,"tag":215,"props":2322,"children":2323},{"class":217,"line":403},[2324,2328,2332,2336],{"type":43,"tag":215,"props":2325,"children":2326},{"style":248},[2327],{"type":49,"value":870},{"type":43,"tag":215,"props":2329,"children":2330},{"style":407},[2331],{"type":49,"value":497},{"type":43,"tag":215,"props":2333,"children":2334},{"style":248},[2335],{"type":49,"value":455},{"type":43,"tag":215,"props":2337,"children":2338},{"style":227},[2339],{"type":49,"value":1805},{"type":43,"tag":215,"props":2341,"children":2342},{"class":217,"line":418},[2343,2347],{"type":43,"tag":215,"props":2344,"children":2345},{"style":407},[2346],{"type":49,"value":890},{"type":43,"tag":215,"props":2348,"children":2349},{"style":248},[2350],{"type":49,"value":415},{"type":43,"tag":215,"props":2352,"children":2353},{"class":217,"line":431},[2354,2358,2362],{"type":43,"tag":215,"props":2355,"children":2356},{"style":407},[2357],{"type":49,"value":902},{"type":43,"tag":215,"props":2359,"children":2360},{"style":248},[2361],{"type":49,"value":455},{"type":43,"tag":215,"props":2363,"children":2364},{"style":227},[2365],{"type":49,"value":1848},{"type":43,"tag":215,"props":2367,"children":2368},{"class":217,"line":444},[2369,2374],{"type":43,"tag":215,"props":2370,"children":2371},{"style":407},[2372],{"type":49,"value":2373},"      base_parameters",{"type":43,"tag":215,"props":2375,"children":2376},{"style":248},[2377],{"type":49,"value":415},{"type":43,"tag":215,"props":2379,"children":2380},{"class":217,"line":473},[2381,2386,2390,2394,2399],{"type":43,"tag":215,"props":2382,"children":2383},{"style":407},[2384],{"type":49,"value":2385},"        env",{"type":43,"tag":215,"props":2387,"children":2388},{"style":248},[2389],{"type":49,"value":455},{"type":43,"tag":215,"props":2391,"children":2392},{"style":248},[2393],{"type":49,"value":460},{"type":43,"tag":215,"props":2395,"children":2396},{"style":227},[2397],{"type":49,"value":2398},"{{job.parameters.env}}",{"type":43,"tag":215,"props":2400,"children":2401},{"style":248},[2402],{"type":49,"value":470},{"type":43,"tag":215,"props":2404,"children":2405},{"class":217,"line":486},[2406,2411,2415,2419,2424],{"type":43,"tag":215,"props":2407,"children":2408},{"style":407},[2409],{"type":49,"value":2410},"        custom_param",{"type":43,"tag":215,"props":2412,"children":2413},{"style":248},[2414],{"type":49,"value":455},{"type":43,"tag":215,"props":2416,"children":2417},{"style":248},[2418],{"type":49,"value":460},{"type":43,"tag":215,"props":2420,"children":2421},{"style":227},[2422],{"type":49,"value":2423},"value",{"type":43,"tag":215,"props":2425,"children":2426},{"style":248},[2427],{"type":49,"value":470},{"type":43,"tag":77,"props":2429,"children":2431},{"id":2430},"common-operations",[2432],{"type":49,"value":2433},"Common Operations",{"type":43,"tag":377,"props":2435,"children":2437},{"id":2436},"python-sdk-1",[2438],{"type":49,"value":543},{"type":43,"tag":204,"props":2440,"children":2442},{"className":546,"code":2441,"language":548,"meta":209,"style":209},"from databricks.sdk import WorkspaceClient\n\nw = WorkspaceClient()\n\n# List jobs\njobs = w.jobs.list()\n\n# Get job details\njob = w.jobs.get(job_id=12345)\n\n# Run job now\nrun = w.jobs.run_now(job_id=12345)\n\n# Run with parameters\nrun = w.jobs.run_now(\n    job_id=12345,\n    job_parameters={\"env\": \"prod\", \"date\": \"2024-01-15\"},\n)\n\n# Cancel run\nw.jobs.cancel_run(run_id=run.run_id)\n\n# Delete job\nw.jobs.delete(job_id=12345)\n",[2443],{"type":43,"tag":64,"props":2444,"children":2445},{"__ignoreMap":209},[2446,2453,2460,2467,2474,2482,2490,2497,2505,2513,2520,2528,2536,2543,2551,2559,2567,2575,2582,2590,2599,2608,2616,2625],{"type":43,"tag":215,"props":2447,"children":2448},{"class":217,"line":218},[2449],{"type":43,"tag":215,"props":2450,"children":2451},{},[2452],{"type":49,"value":560},{"type":43,"tag":215,"props":2454,"children":2455},{"class":217,"line":403},[2456],{"type":43,"tag":215,"props":2457,"children":2458},{"emptyLinePlaceholder":574},[2459],{"type":49,"value":577},{"type":43,"tag":215,"props":2461,"children":2462},{"class":217,"line":418},[2463],{"type":43,"tag":215,"props":2464,"children":2465},{},[2466],{"type":49,"value":585},{"type":43,"tag":215,"props":2468,"children":2469},{"class":217,"line":431},[2470],{"type":43,"tag":215,"props":2471,"children":2472},{"emptyLinePlaceholder":574},[2473],{"type":49,"value":577},{"type":43,"tag":215,"props":2475,"children":2476},{"class":217,"line":444},[2477],{"type":43,"tag":215,"props":2478,"children":2479},{},[2480],{"type":49,"value":2481},"# List jobs\n",{"type":43,"tag":215,"props":2483,"children":2484},{"class":217,"line":473},[2485],{"type":43,"tag":215,"props":2486,"children":2487},{},[2488],{"type":49,"value":2489},"jobs = w.jobs.list()\n",{"type":43,"tag":215,"props":2491,"children":2492},{"class":217,"line":486},[2493],{"type":43,"tag":215,"props":2494,"children":2495},{"emptyLinePlaceholder":574},[2496],{"type":49,"value":577},{"type":43,"tag":215,"props":2498,"children":2499},{"class":217,"line":509},[2500],{"type":43,"tag":215,"props":2501,"children":2502},{},[2503],{"type":49,"value":2504},"# Get job details\n",{"type":43,"tag":215,"props":2506,"children":2507},{"class":217,"line":522},[2508],{"type":43,"tag":215,"props":2509,"children":2510},{},[2511],{"type":49,"value":2512},"job = w.jobs.get(job_id=12345)\n",{"type":43,"tag":215,"props":2514,"children":2515},{"class":217,"line":627},[2516],{"type":43,"tag":215,"props":2517,"children":2518},{"emptyLinePlaceholder":574},[2519],{"type":49,"value":577},{"type":43,"tag":215,"props":2521,"children":2522},{"class":217,"line":636},[2523],{"type":43,"tag":215,"props":2524,"children":2525},{},[2526],{"type":49,"value":2527},"# Run job now\n",{"type":43,"tag":215,"props":2529,"children":2530},{"class":217,"line":645},[2531],{"type":43,"tag":215,"props":2532,"children":2533},{},[2534],{"type":49,"value":2535},"run = w.jobs.run_now(job_id=12345)\n",{"type":43,"tag":215,"props":2537,"children":2538},{"class":217,"line":654},[2539],{"type":43,"tag":215,"props":2540,"children":2541},{"emptyLinePlaceholder":574},[2542],{"type":49,"value":577},{"type":43,"tag":215,"props":2544,"children":2545},{"class":217,"line":663},[2546],{"type":43,"tag":215,"props":2547,"children":2548},{},[2549],{"type":49,"value":2550},"# Run with parameters\n",{"type":43,"tag":215,"props":2552,"children":2553},{"class":217,"line":672},[2554],{"type":43,"tag":215,"props":2555,"children":2556},{},[2557],{"type":49,"value":2558},"run = w.jobs.run_now(\n",{"type":43,"tag":215,"props":2560,"children":2561},{"class":217,"line":681},[2562],{"type":43,"tag":215,"props":2563,"children":2564},{},[2565],{"type":49,"value":2566},"    job_id=12345,\n",{"type":43,"tag":215,"props":2568,"children":2569},{"class":217,"line":690},[2570],{"type":43,"tag":215,"props":2571,"children":2572},{},[2573],{"type":49,"value":2574},"    job_parameters={\"env\": \"prod\", \"date\": \"2024-01-15\"},\n",{"type":43,"tag":215,"props":2576,"children":2577},{"class":217,"line":699},[2578],{"type":43,"tag":215,"props":2579,"children":2580},{},[2581],{"type":49,"value":696},{"type":43,"tag":215,"props":2583,"children":2585},{"class":217,"line":2584},19,[2586],{"type":43,"tag":215,"props":2587,"children":2588},{"emptyLinePlaceholder":574},[2589],{"type":49,"value":577},{"type":43,"tag":215,"props":2591,"children":2593},{"class":217,"line":2592},20,[2594],{"type":43,"tag":215,"props":2595,"children":2596},{},[2597],{"type":49,"value":2598},"# Cancel run\n",{"type":43,"tag":215,"props":2600,"children":2602},{"class":217,"line":2601},21,[2603],{"type":43,"tag":215,"props":2604,"children":2605},{},[2606],{"type":49,"value":2607},"w.jobs.cancel_run(run_id=run.run_id)\n",{"type":43,"tag":215,"props":2609,"children":2611},{"class":217,"line":2610},22,[2612],{"type":43,"tag":215,"props":2613,"children":2614},{"emptyLinePlaceholder":574},[2615],{"type":49,"value":577},{"type":43,"tag":215,"props":2617,"children":2619},{"class":217,"line":2618},23,[2620],{"type":43,"tag":215,"props":2621,"children":2622},{},[2623],{"type":49,"value":2624},"# Delete job\n",{"type":43,"tag":215,"props":2626,"children":2628},{"class":217,"line":2627},24,[2629],{"type":43,"tag":215,"props":2630,"children":2631},{},[2632],{"type":49,"value":2633},"w.jobs.delete(job_id=12345)\n",{"type":43,"tag":377,"props":2635,"children":2637},{"id":2636},"cli-1",[2638],{"type":49,"value":711},{"type":43,"tag":204,"props":2640,"children":2642},{"className":206,"code":2641,"language":208,"meta":209,"style":209},"# List jobs\ndatabricks jobs list\n\n# Get job details\ndatabricks jobs get 12345\n\n# Run job\ndatabricks jobs run-now 12345\n\n# Run with parameters (must use --json with job_id inside)\ndatabricks jobs run-now --json '{\"job_id\": 12345, \"job_parameters\": {\"env\": \"prod\"}}'\n\n# Cancel run\ndatabricks jobs cancel-run 67890\n\n# Delete job\ndatabricks jobs delete 12345\n",[2643],{"type":43,"tag":64,"props":2644,"children":2645},{"__ignoreMap":209},[2646,2653,2669,2676,2683,2704,2711,2719,2739,2746,2754,2786,2793,2800,2821,2828,2835],{"type":43,"tag":215,"props":2647,"children":2648},{"class":217,"line":218},[2649],{"type":43,"tag":215,"props":2650,"children":2651},{"style":397},[2652],{"type":49,"value":2481},{"type":43,"tag":215,"props":2654,"children":2655},{"class":217,"line":403},[2656,2660,2664],{"type":43,"tag":215,"props":2657,"children":2658},{"style":222},[2659],{"type":49,"value":8},{"type":43,"tag":215,"props":2661,"children":2662},{"style":227},[2663],{"type":49,"value":730},{"type":43,"tag":215,"props":2665,"children":2666},{"style":227},[2667],{"type":49,"value":2668}," list\n",{"type":43,"tag":215,"props":2670,"children":2671},{"class":217,"line":418},[2672],{"type":43,"tag":215,"props":2673,"children":2674},{"emptyLinePlaceholder":574},[2675],{"type":49,"value":577},{"type":43,"tag":215,"props":2677,"children":2678},{"class":217,"line":431},[2679],{"type":43,"tag":215,"props":2680,"children":2681},{"style":397},[2682],{"type":49,"value":2504},{"type":43,"tag":215,"props":2684,"children":2685},{"class":217,"line":444},[2686,2690,2694,2699],{"type":43,"tag":215,"props":2687,"children":2688},{"style":222},[2689],{"type":49,"value":8},{"type":43,"tag":215,"props":2691,"children":2692},{"style":227},[2693],{"type":49,"value":730},{"type":43,"tag":215,"props":2695,"children":2696},{"style":227},[2697],{"type":49,"value":2698}," get",{"type":43,"tag":215,"props":2700,"children":2701},{"style":1727},[2702],{"type":49,"value":2703}," 12345\n",{"type":43,"tag":215,"props":2705,"children":2706},{"class":217,"line":473},[2707],{"type":43,"tag":215,"props":2708,"children":2709},{"emptyLinePlaceholder":574},[2710],{"type":49,"value":577},{"type":43,"tag":215,"props":2712,"children":2713},{"class":217,"line":486},[2714],{"type":43,"tag":215,"props":2715,"children":2716},{"style":397},[2717],{"type":49,"value":2718},"# Run job\n",{"type":43,"tag":215,"props":2720,"children":2721},{"class":217,"line":509},[2722,2726,2730,2735],{"type":43,"tag":215,"props":2723,"children":2724},{"style":222},[2725],{"type":49,"value":8},{"type":43,"tag":215,"props":2727,"children":2728},{"style":227},[2729],{"type":49,"value":730},{"type":43,"tag":215,"props":2731,"children":2732},{"style":227},[2733],{"type":49,"value":2734}," run-now",{"type":43,"tag":215,"props":2736,"children":2737},{"style":1727},[2738],{"type":49,"value":2703},{"type":43,"tag":215,"props":2740,"children":2741},{"class":217,"line":522},[2742],{"type":43,"tag":215,"props":2743,"children":2744},{"emptyLinePlaceholder":574},[2745],{"type":49,"value":577},{"type":43,"tag":215,"props":2747,"children":2748},{"class":217,"line":627},[2749],{"type":43,"tag":215,"props":2750,"children":2751},{"style":397},[2752],{"type":49,"value":2753},"# Run with parameters (must use --json with job_id inside)\n",{"type":43,"tag":215,"props":2755,"children":2756},{"class":217,"line":636},[2757,2761,2765,2769,2773,2777,2782],{"type":43,"tag":215,"props":2758,"children":2759},{"style":222},[2760],{"type":49,"value":8},{"type":43,"tag":215,"props":2762,"children":2763},{"style":227},[2764],{"type":49,"value":730},{"type":43,"tag":215,"props":2766,"children":2767},{"style":227},[2768],{"type":49,"value":2734},{"type":43,"tag":215,"props":2770,"children":2771},{"style":227},[2772],{"type":49,"value":740},{"type":43,"tag":215,"props":2774,"children":2775},{"style":248},[2776],{"type":49,"value":262},{"type":43,"tag":215,"props":2778,"children":2779},{"style":227},[2780],{"type":49,"value":2781},"{\"job_id\": 12345, \"job_parameters\": {\"env\": \"prod\"}}",{"type":43,"tag":215,"props":2783,"children":2784},{"style":248},[2785],{"type":49,"value":826},{"type":43,"tag":215,"props":2787,"children":2788},{"class":217,"line":645},[2789],{"type":43,"tag":215,"props":2790,"children":2791},{"emptyLinePlaceholder":574},[2792],{"type":49,"value":577},{"type":43,"tag":215,"props":2794,"children":2795},{"class":217,"line":654},[2796],{"type":43,"tag":215,"props":2797,"children":2798},{"style":397},[2799],{"type":49,"value":2598},{"type":43,"tag":215,"props":2801,"children":2802},{"class":217,"line":663},[2803,2807,2811,2816],{"type":43,"tag":215,"props":2804,"children":2805},{"style":222},[2806],{"type":49,"value":8},{"type":43,"tag":215,"props":2808,"children":2809},{"style":227},[2810],{"type":49,"value":730},{"type":43,"tag":215,"props":2812,"children":2813},{"style":227},[2814],{"type":49,"value":2815}," cancel-run",{"type":43,"tag":215,"props":2817,"children":2818},{"style":1727},[2819],{"type":49,"value":2820}," 67890\n",{"type":43,"tag":215,"props":2822,"children":2823},{"class":217,"line":672},[2824],{"type":43,"tag":215,"props":2825,"children":2826},{"emptyLinePlaceholder":574},[2827],{"type":49,"value":577},{"type":43,"tag":215,"props":2829,"children":2830},{"class":217,"line":681},[2831],{"type":43,"tag":215,"props":2832,"children":2833},{"style":397},[2834],{"type":49,"value":2624},{"type":43,"tag":215,"props":2836,"children":2837},{"class":217,"line":690},[2838,2842,2846,2851],{"type":43,"tag":215,"props":2839,"children":2840},{"style":222},[2841],{"type":49,"value":8},{"type":43,"tag":215,"props":2843,"children":2844},{"style":227},[2845],{"type":49,"value":730},{"type":43,"tag":215,"props":2847,"children":2848},{"style":227},[2849],{"type":49,"value":2850}," delete",{"type":43,"tag":215,"props":2852,"children":2853},{"style":1727},[2854],{"type":49,"value":2703},{"type":43,"tag":377,"props":2856,"children":2858},{"id":2857},"asset-bundle-operations",[2859],{"type":49,"value":2860},"Asset Bundle Operations",{"type":43,"tag":204,"props":2862,"children":2864},{"className":206,"code":2863,"language":208,"meta":209,"style":209},"# Validate configuration\ndatabricks bundle validate --profile \u003Cprofile>\n\n# Deploy to a target\ndatabricks bundle deploy -t dev --profile \u003Cprofile>\n\n# Run a job\ndatabricks bundle run \u003Cjob_name> -t dev --profile \u003Cprofile>\n\n# Check run status\ndatabricks jobs get-run --run-id \u003Cid> --profile \u003Cprofile>\n\n# Destroy resources\ndatabricks bundle destroy --auto-approve\n",[2865],{"type":43,"tag":64,"props":2866,"children":2867},{"__ignoreMap":209},[2868,2876,2915,2922,2930,2976,2983,2991,3052,3059,3067,3126,3133,3141],{"type":43,"tag":215,"props":2869,"children":2870},{"class":217,"line":218},[2871],{"type":43,"tag":215,"props":2872,"children":2873},{"style":397},[2874],{"type":49,"value":2875},"# Validate configuration\n",{"type":43,"tag":215,"props":2877,"children":2878},{"class":217,"line":403},[2879,2883,2887,2892,2896,2900,2905,2910],{"type":43,"tag":215,"props":2880,"children":2881},{"style":222},[2882],{"type":49,"value":8},{"type":43,"tag":215,"props":2884,"children":2885},{"style":227},[2886],{"type":49,"value":230},{"type":43,"tag":215,"props":2888,"children":2889},{"style":227},[2890],{"type":49,"value":2891}," validate",{"type":43,"tag":215,"props":2893,"children":2894},{"style":227},[2895],{"type":49,"value":277},{"type":43,"tag":215,"props":2897,"children":2898},{"style":248},[2899],{"type":49,"value":282},{"type":43,"tag":215,"props":2901,"children":2902},{"style":227},[2903],{"type":49,"value":2904},"profil",{"type":43,"tag":215,"props":2906,"children":2907},{"style":290},[2908],{"type":49,"value":2909},"e",{"type":43,"tag":215,"props":2911,"children":2912},{"style":248},[2913],{"type":49,"value":2914},">\n",{"type":43,"tag":215,"props":2916,"children":2917},{"class":217,"line":418},[2918],{"type":43,"tag":215,"props":2919,"children":2920},{"emptyLinePlaceholder":574},[2921],{"type":49,"value":577},{"type":43,"tag":215,"props":2923,"children":2924},{"class":217,"line":431},[2925],{"type":43,"tag":215,"props":2926,"children":2927},{"style":397},[2928],{"type":49,"value":2929},"# Deploy to a target\n",{"type":43,"tag":215,"props":2931,"children":2932},{"class":217,"line":444},[2933,2937,2941,2946,2951,2956,2960,2964,2968,2972],{"type":43,"tag":215,"props":2934,"children":2935},{"style":222},[2936],{"type":49,"value":8},{"type":43,"tag":215,"props":2938,"children":2939},{"style":227},[2940],{"type":49,"value":230},{"type":43,"tag":215,"props":2942,"children":2943},{"style":227},[2944],{"type":49,"value":2945}," deploy",{"type":43,"tag":215,"props":2947,"children":2948},{"style":227},[2949],{"type":49,"value":2950}," -t",{"type":43,"tag":215,"props":2952,"children":2953},{"style":227},[2954],{"type":49,"value":2955}," dev",{"type":43,"tag":215,"props":2957,"children":2958},{"style":227},[2959],{"type":49,"value":277},{"type":43,"tag":215,"props":2961,"children":2962},{"style":248},[2963],{"type":49,"value":282},{"type":43,"tag":215,"props":2965,"children":2966},{"style":227},[2967],{"type":49,"value":2904},{"type":43,"tag":215,"props":2969,"children":2970},{"style":290},[2971],{"type":49,"value":2909},{"type":43,"tag":215,"props":2973,"children":2974},{"style":248},[2975],{"type":49,"value":2914},{"type":43,"tag":215,"props":2977,"children":2978},{"class":217,"line":473},[2979],{"type":43,"tag":215,"props":2980,"children":2981},{"emptyLinePlaceholder":574},[2982],{"type":49,"value":577},{"type":43,"tag":215,"props":2984,"children":2985},{"class":217,"line":486},[2986],{"type":43,"tag":215,"props":2987,"children":2988},{"style":397},[2989],{"type":49,"value":2990},"# Run a job\n",{"type":43,"tag":215,"props":2992,"children":2993},{"class":217,"line":509},[2994,2998,3002,3007,3011,3016,3020,3024,3028,3032,3036,3040,3044,3048],{"type":43,"tag":215,"props":2995,"children":2996},{"style":222},[2997],{"type":49,"value":8},{"type":43,"tag":215,"props":2999,"children":3000},{"style":227},[3001],{"type":49,"value":230},{"type":43,"tag":215,"props":3003,"children":3004},{"style":227},[3005],{"type":49,"value":3006}," run",{"type":43,"tag":215,"props":3008,"children":3009},{"style":248},[3010],{"type":49,"value":282},{"type":43,"tag":215,"props":3012,"children":3013},{"style":227},[3014],{"type":49,"value":3015},"job_nam",{"type":43,"tag":215,"props":3017,"children":3018},{"style":290},[3019],{"type":49,"value":2909},{"type":43,"tag":215,"props":3021,"children":3022},{"style":248},[3023],{"type":49,"value":298},{"type":43,"tag":215,"props":3025,"children":3026},{"style":227},[3027],{"type":49,"value":2950},{"type":43,"tag":215,"props":3029,"children":3030},{"style":227},[3031],{"type":49,"value":2955},{"type":43,"tag":215,"props":3033,"children":3034},{"style":227},[3035],{"type":49,"value":277},{"type":43,"tag":215,"props":3037,"children":3038},{"style":248},[3039],{"type":49,"value":282},{"type":43,"tag":215,"props":3041,"children":3042},{"style":227},[3043],{"type":49,"value":2904},{"type":43,"tag":215,"props":3045,"children":3046},{"style":290},[3047],{"type":49,"value":2909},{"type":43,"tag":215,"props":3049,"children":3050},{"style":248},[3051],{"type":49,"value":2914},{"type":43,"tag":215,"props":3053,"children":3054},{"class":217,"line":522},[3055],{"type":43,"tag":215,"props":3056,"children":3057},{"emptyLinePlaceholder":574},[3058],{"type":49,"value":577},{"type":43,"tag":215,"props":3060,"children":3061},{"class":217,"line":627},[3062],{"type":43,"tag":215,"props":3063,"children":3064},{"style":397},[3065],{"type":49,"value":3066},"# Check run status\n",{"type":43,"tag":215,"props":3068,"children":3069},{"class":217,"line":636},[3070,3074,3078,3083,3088,3092,3097,3102,3106,3110,3114,3118,3122],{"type":43,"tag":215,"props":3071,"children":3072},{"style":222},[3073],{"type":49,"value":8},{"type":43,"tag":215,"props":3075,"children":3076},{"style":227},[3077],{"type":49,"value":730},{"type":43,"tag":215,"props":3079,"children":3080},{"style":227},[3081],{"type":49,"value":3082}," get-run",{"type":43,"tag":215,"props":3084,"children":3085},{"style":227},[3086],{"type":49,"value":3087}," --run-id",{"type":43,"tag":215,"props":3089,"children":3090},{"style":248},[3091],{"type":49,"value":282},{"type":43,"tag":215,"props":3093,"children":3094},{"style":227},[3095],{"type":49,"value":3096},"i",{"type":43,"tag":215,"props":3098,"children":3099},{"style":290},[3100],{"type":49,"value":3101},"d",{"type":43,"tag":215,"props":3103,"children":3104},{"style":248},[3105],{"type":49,"value":298},{"type":43,"tag":215,"props":3107,"children":3108},{"style":227},[3109],{"type":49,"value":277},{"type":43,"tag":215,"props":3111,"children":3112},{"style":248},[3113],{"type":49,"value":282},{"type":43,"tag":215,"props":3115,"children":3116},{"style":227},[3117],{"type":49,"value":2904},{"type":43,"tag":215,"props":3119,"children":3120},{"style":290},[3121],{"type":49,"value":2909},{"type":43,"tag":215,"props":3123,"children":3124},{"style":248},[3125],{"type":49,"value":2914},{"type":43,"tag":215,"props":3127,"children":3128},{"class":217,"line":645},[3129],{"type":43,"tag":215,"props":3130,"children":3131},{"emptyLinePlaceholder":574},[3132],{"type":49,"value":577},{"type":43,"tag":215,"props":3134,"children":3135},{"class":217,"line":654},[3136],{"type":43,"tag":215,"props":3137,"children":3138},{"style":397},[3139],{"type":49,"value":3140},"# Destroy resources\n",{"type":43,"tag":215,"props":3142,"children":3143},{"class":217,"line":663},[3144,3148,3152,3157],{"type":43,"tag":215,"props":3145,"children":3146},{"style":222},[3147],{"type":49,"value":8},{"type":43,"tag":215,"props":3149,"children":3150},{"style":227},[3151],{"type":49,"value":230},{"type":43,"tag":215,"props":3153,"children":3154},{"style":227},[3155],{"type":49,"value":3156}," destroy",{"type":43,"tag":215,"props":3158,"children":3159},{"style":227},[3160],{"type":49,"value":3161}," --auto-approve\n",{"type":43,"tag":77,"props":3163,"children":3165},{"id":3164},"permissions-dabs",[3166],{"type":49,"value":3167},"Permissions (DABs)",{"type":43,"tag":204,"props":3169,"children":3171},{"className":385,"code":3170,"language":387,"meta":209,"style":209},"resources:\n  jobs:\n    my_job:\n      name: \"My Job\"\n      permissions:\n        - level: CAN_VIEW\n          group_name: \"data-analysts\"\n        - level: CAN_MANAGE_RUN\n          group_name: \"data-engineers\"\n        - level: CAN_MANAGE\n          user_name: \"admin@example.com\"\n",[3172],{"type":43,"tag":64,"props":3173,"children":3174},{"__ignoreMap":209},[3175,3186,3197,3209,3233,3245,3266,3291,3311,3335,3355],{"type":43,"tag":215,"props":3176,"children":3177},{"class":217,"line":218},[3178,3182],{"type":43,"tag":215,"props":3179,"children":3180},{"style":407},[3181],{"type":49,"value":410},{"type":43,"tag":215,"props":3183,"children":3184},{"style":248},[3185],{"type":49,"value":415},{"type":43,"tag":215,"props":3187,"children":3188},{"class":217,"line":403},[3189,3193],{"type":43,"tag":215,"props":3190,"children":3191},{"style":407},[3192],{"type":49,"value":424},{"type":43,"tag":215,"props":3194,"children":3195},{"style":248},[3196],{"type":49,"value":415},{"type":43,"tag":215,"props":3198,"children":3199},{"class":217,"line":418},[3200,3205],{"type":43,"tag":215,"props":3201,"children":3202},{"style":407},[3203],{"type":49,"value":3204},"    my_job",{"type":43,"tag":215,"props":3206,"children":3207},{"style":248},[3208],{"type":49,"value":415},{"type":43,"tag":215,"props":3210,"children":3211},{"class":217,"line":431},[3212,3216,3220,3224,3229],{"type":43,"tag":215,"props":3213,"children":3214},{"style":407},[3215],{"type":49,"value":450},{"type":43,"tag":215,"props":3217,"children":3218},{"style":248},[3219],{"type":49,"value":455},{"type":43,"tag":215,"props":3221,"children":3222},{"style":248},[3223],{"type":49,"value":460},{"type":43,"tag":215,"props":3225,"children":3226},{"style":227},[3227],{"type":49,"value":3228},"My Job",{"type":43,"tag":215,"props":3230,"children":3231},{"style":248},[3232],{"type":49,"value":470},{"type":43,"tag":215,"props":3234,"children":3235},{"class":217,"line":444},[3236,3241],{"type":43,"tag":215,"props":3237,"children":3238},{"style":407},[3239],{"type":49,"value":3240},"      permissions",{"type":43,"tag":215,"props":3242,"children":3243},{"style":248},[3244],{"type":49,"value":415},{"type":43,"tag":215,"props":3246,"children":3247},{"class":217,"line":473},[3248,3252,3257,3261],{"type":43,"tag":215,"props":3249,"children":3250},{"style":248},[3251],{"type":49,"value":492},{"type":43,"tag":215,"props":3253,"children":3254},{"style":407},[3255],{"type":49,"value":3256}," level",{"type":43,"tag":215,"props":3258,"children":3259},{"style":248},[3260],{"type":49,"value":455},{"type":43,"tag":215,"props":3262,"children":3263},{"style":227},[3264],{"type":49,"value":3265}," CAN_VIEW\n",{"type":43,"tag":215,"props":3267,"children":3268},{"class":217,"line":486},[3269,3274,3278,3282,3287],{"type":43,"tag":215,"props":3270,"children":3271},{"style":407},[3272],{"type":49,"value":3273},"          group_name",{"type":43,"tag":215,"props":3275,"children":3276},{"style":248},[3277],{"type":49,"value":455},{"type":43,"tag":215,"props":3279,"children":3280},{"style":248},[3281],{"type":49,"value":460},{"type":43,"tag":215,"props":3283,"children":3284},{"style":227},[3285],{"type":49,"value":3286},"data-analysts",{"type":43,"tag":215,"props":3288,"children":3289},{"style":248},[3290],{"type":49,"value":470},{"type":43,"tag":215,"props":3292,"children":3293},{"class":217,"line":509},[3294,3298,3302,3306],{"type":43,"tag":215,"props":3295,"children":3296},{"style":248},[3297],{"type":49,"value":492},{"type":43,"tag":215,"props":3299,"children":3300},{"style":407},[3301],{"type":49,"value":3256},{"type":43,"tag":215,"props":3303,"children":3304},{"style":248},[3305],{"type":49,"value":455},{"type":43,"tag":215,"props":3307,"children":3308},{"style":227},[3309],{"type":49,"value":3310}," CAN_MANAGE_RUN\n",{"type":43,"tag":215,"props":3312,"children":3313},{"class":217,"line":522},[3314,3318,3322,3326,3331],{"type":43,"tag":215,"props":3315,"children":3316},{"style":407},[3317],{"type":49,"value":3273},{"type":43,"tag":215,"props":3319,"children":3320},{"style":248},[3321],{"type":49,"value":455},{"type":43,"tag":215,"props":3323,"children":3324},{"style":248},[3325],{"type":49,"value":460},{"type":43,"tag":215,"props":3327,"children":3328},{"style":227},[3329],{"type":49,"value":3330},"data-engineers",{"type":43,"tag":215,"props":3332,"children":3333},{"style":248},[3334],{"type":49,"value":470},{"type":43,"tag":215,"props":3336,"children":3337},{"class":217,"line":627},[3338,3342,3346,3350],{"type":43,"tag":215,"props":3339,"children":3340},{"style":248},[3341],{"type":49,"value":492},{"type":43,"tag":215,"props":3343,"children":3344},{"style":407},[3345],{"type":49,"value":3256},{"type":43,"tag":215,"props":3347,"children":3348},{"style":248},[3349],{"type":49,"value":455},{"type":43,"tag":215,"props":3351,"children":3352},{"style":227},[3353],{"type":49,"value":3354}," CAN_MANAGE\n",{"type":43,"tag":215,"props":3356,"children":3357},{"class":217,"line":636},[3358,3363,3367,3371,3376],{"type":43,"tag":215,"props":3359,"children":3360},{"style":407},[3361],{"type":49,"value":3362},"          user_name",{"type":43,"tag":215,"props":3364,"children":3365},{"style":248},[3366],{"type":49,"value":455},{"type":43,"tag":215,"props":3368,"children":3369},{"style":248},[3370],{"type":49,"value":460},{"type":43,"tag":215,"props":3372,"children":3373},{"style":227},[3374],{"type":49,"value":3375},"admin@example.com",{"type":43,"tag":215,"props":3377,"children":3378},{"style":248},[3379],{"type":49,"value":470},{"type":43,"tag":52,"props":3381,"children":3382},{},[3383],{"type":43,"tag":56,"props":3384,"children":3385},{},[3386],{"type":49,"value":3387},"Permission levels:",{"type":43,"tag":309,"props":3389,"children":3390},{},[3391,3402,3413],{"type":43,"tag":313,"props":3392,"children":3393},{},[3394,3400],{"type":43,"tag":64,"props":3395,"children":3397},{"className":3396},[],[3398],{"type":49,"value":3399},"CAN_VIEW",{"type":49,"value":3401}," — view job and run history",{"type":43,"tag":313,"props":3403,"children":3404},{},[3405,3411],{"type":43,"tag":64,"props":3406,"children":3408},{"className":3407},[],[3409],{"type":49,"value":3410},"CAN_MANAGE_RUN",{"type":49,"value":3412}," — view, trigger, and cancel runs",{"type":43,"tag":313,"props":3414,"children":3415},{},[3416,3422],{"type":43,"tag":64,"props":3417,"children":3419},{"className":3418},[],[3420],{"type":49,"value":3421},"CAN_MANAGE",{"type":49,"value":3423}," — full control including edit and delete",{"type":43,"tag":77,"props":3425,"children":3427},{"id":3426},"unit-testing",[3428],{"type":49,"value":3429},"Unit Testing",{"type":43,"tag":52,"props":3431,"children":3432},{},[3433],{"type":49,"value":3434},"Run unit tests locally:",{"type":43,"tag":204,"props":3436,"children":3438},{"className":206,"code":3437,"language":208,"meta":209,"style":209},"uv run pytest\n",[3439],{"type":43,"tag":64,"props":3440,"children":3441},{"__ignoreMap":209},[3442],{"type":43,"tag":215,"props":3443,"children":3444},{"class":217,"line":218},[3445,3450,3454],{"type":43,"tag":215,"props":3446,"children":3447},{"style":222},[3448],{"type":49,"value":3449},"uv",{"type":43,"tag":215,"props":3451,"children":3452},{"style":227},[3453],{"type":49,"value":3006},{"type":43,"tag":215,"props":3455,"children":3456},{"style":227},[3457],{"type":49,"value":3458}," pytest\n",{"type":43,"tag":77,"props":3460,"children":3462},{"id":3461},"development-workflow",[3463],{"type":49,"value":3464},"Development Workflow",{"type":43,"tag":3466,"props":3467,"children":3468},"ol",{},[3469,3485,3500,3515],{"type":43,"tag":313,"props":3470,"children":3471},{},[3472,3477,3479],{"type":43,"tag":56,"props":3473,"children":3474},{},[3475],{"type":49,"value":3476},"Validate",{"type":49,"value":3478},": ",{"type":43,"tag":64,"props":3480,"children":3482},{"className":3481},[],[3483],{"type":49,"value":3484},"databricks bundle validate --profile \u003Cprofile>",{"type":43,"tag":313,"props":3486,"children":3487},{},[3488,3493,3494],{"type":43,"tag":56,"props":3489,"children":3490},{},[3491],{"type":49,"value":3492},"Deploy",{"type":49,"value":3478},{"type":43,"tag":64,"props":3495,"children":3497},{"className":3496},[],[3498],{"type":49,"value":3499},"databricks bundle deploy -t dev --profile \u003Cprofile>",{"type":43,"tag":313,"props":3501,"children":3502},{},[3503,3508,3509],{"type":43,"tag":56,"props":3504,"children":3505},{},[3506],{"type":49,"value":3507},"Run",{"type":49,"value":3478},{"type":43,"tag":64,"props":3510,"children":3512},{"className":3511},[],[3513],{"type":49,"value":3514},"databricks bundle run \u003Cjob_name> -t dev --profile \u003Cprofile>",{"type":43,"tag":313,"props":3516,"children":3517},{},[3518,3523,3524],{"type":43,"tag":56,"props":3519,"children":3520},{},[3521],{"type":49,"value":3522},"Check run status",{"type":49,"value":3478},{"type":43,"tag":64,"props":3525,"children":3527},{"className":3526},[],[3528],{"type":49,"value":3529},"databricks jobs get-run --run-id \u003Cid> --profile \u003Cprofile>",{"type":43,"tag":77,"props":3531,"children":3533},{"id":3532},"common-issues",[3534],{"type":49,"value":3535},"Common Issues",{"type":43,"tag":84,"props":3537,"children":3538},{},[3539,3555],{"type":43,"tag":88,"props":3540,"children":3541},{},[3542],{"type":43,"tag":92,"props":3543,"children":3544},{},[3545,3550],{"type":43,"tag":96,"props":3546,"children":3547},{},[3548],{"type":49,"value":3549},"Issue",{"type":43,"tag":96,"props":3551,"children":3552},{},[3553],{"type":49,"value":3554},"Solution",{"type":43,"tag":107,"props":3556,"children":3557},{},[3558,3579,3606,3627,3640,3653,3673,3692],{"type":43,"tag":92,"props":3559,"children":3560},{},[3561,3566],{"type":43,"tag":114,"props":3562,"children":3563},{},[3564],{"type":49,"value":3565},"Job cluster startup slow",{"type":43,"tag":114,"props":3567,"children":3568},{},[3569,3571,3577],{"type":49,"value":3570},"Use job clusters with ",{"type":43,"tag":64,"props":3572,"children":3574},{"className":3573},[],[3575],{"type":49,"value":3576},"job_cluster_key",{"type":49,"value":3578}," for reuse across tasks",{"type":43,"tag":92,"props":3580,"children":3581},{},[3582,3587],{"type":43,"tag":114,"props":3583,"children":3584},{},[3585],{"type":49,"value":3586},"Task dependencies not working",{"type":43,"tag":114,"props":3588,"children":3589},{},[3590,3592,3598,3600],{"type":49,"value":3591},"Verify ",{"type":43,"tag":64,"props":3593,"children":3595},{"className":3594},[],[3596],{"type":49,"value":3597},"task_key",{"type":49,"value":3599}," references match exactly in ",{"type":43,"tag":64,"props":3601,"children":3603},{"className":3602},[],[3604],{"type":49,"value":3605},"depends_on",{"type":43,"tag":92,"props":3607,"children":3608},{},[3609,3614],{"type":43,"tag":114,"props":3610,"children":3611},{},[3612],{"type":49,"value":3613},"Schedule not triggering",{"type":43,"tag":114,"props":3615,"children":3616},{},[3617,3619,3625],{"type":49,"value":3618},"Check ",{"type":43,"tag":64,"props":3620,"children":3622},{"className":3621},[],[3623],{"type":49,"value":3624},"pause_status: UNPAUSED",{"type":49,"value":3626}," and valid timezone",{"type":43,"tag":92,"props":3628,"children":3629},{},[3630,3635],{"type":43,"tag":114,"props":3631,"children":3632},{},[3633],{"type":49,"value":3634},"File arrival not detecting",{"type":43,"tag":114,"props":3636,"children":3637},{},[3638],{"type":49,"value":3639},"Ensure path has proper permissions and uses cloud storage URL",{"type":43,"tag":92,"props":3641,"children":3642},{},[3643,3648],{"type":43,"tag":114,"props":3644,"children":3645},{},[3646],{"type":49,"value":3647},"Table update trigger missing events",{"type":43,"tag":114,"props":3649,"children":3650},{},[3651],{"type":49,"value":3652},"Verify Unity Catalog table and proper grants",{"type":43,"tag":92,"props":3654,"children":3655},{},[3656,3661],{"type":43,"tag":114,"props":3657,"children":3658},{},[3659],{"type":49,"value":3660},"Parameter not accessible",{"type":43,"tag":114,"props":3662,"children":3663},{},[3664,3665,3671],{"type":49,"value":186},{"type":43,"tag":64,"props":3666,"children":3668},{"className":3667},[],[3669],{"type":49,"value":3670},"dbutils.widgets.get()",{"type":49,"value":3672}," in notebooks",{"type":43,"tag":92,"props":3674,"children":3675},{},[3676,3687],{"type":43,"tag":114,"props":3677,"children":3678},{},[3679,3685],{"type":43,"tag":64,"props":3680,"children":3682},{"className":3681},[],[3683],{"type":49,"value":3684},"admins",{"type":49,"value":3686}," group error",{"type":43,"tag":114,"props":3688,"children":3689},{},[3690],{"type":49,"value":3691},"Cannot modify admins permissions on jobs",{"type":43,"tag":92,"props":3693,"children":3694},{},[3695,3700],{"type":43,"tag":114,"props":3696,"children":3697},{},[3698],{"type":49,"value":3699},"Serverless task fails",{"type":43,"tag":114,"props":3701,"children":3702},{},[3703],{"type":49,"value":3704},"Ensure task type supports serverless (notebook, Python)",{"type":43,"tag":77,"props":3706,"children":3708},{"id":3707},"related-skills",[3709],{"type":49,"value":3710},"Related Skills",{"type":43,"tag":309,"props":3712,"children":3713},{},[3714,3724],{"type":43,"tag":313,"props":3715,"children":3716},{},[3717,3722],{"type":43,"tag":56,"props":3718,"children":3719},{},[3720],{"type":49,"value":3721},"databricks-dabs",{"type":49,"value":3723}," — DABs configuration patterns shared by jobs and pipelines",{"type":43,"tag":313,"props":3725,"children":3726},{},[3727,3732,3734],{"type":43,"tag":56,"props":3728,"children":3729},{},[3730],{"type":49,"value":3731},"databricks-pipelines",{"type":49,"value":3733}," — SDP (formerly DLT) pipelines triggered by ",{"type":43,"tag":64,"props":3735,"children":3737},{"className":3736},[],[3738],{"type":49,"value":1349},{"type":43,"tag":77,"props":3740,"children":3742},{"id":3741},"documentation",[3743],{"type":49,"value":3744},"Documentation",{"type":43,"tag":309,"props":3746,"children":3747},{},[3748,3759,3769,3779,3789],{"type":43,"tag":313,"props":3749,"children":3750},{},[3751],{"type":43,"tag":123,"props":3752,"children":3756},{"href":3753,"rel":3754},"https:\u002F\u002Fdocs.databricks.com\u002Fjobs",[3755],"nofollow",[3757],{"type":49,"value":3758},"Lakeflow Jobs",{"type":43,"tag":313,"props":3760,"children":3761},{},[3762],{"type":43,"tag":123,"props":3763,"children":3766},{"href":3764,"rel":3765},"https:\u002F\u002Fdocs.databricks.com\u002Fjobs\u002Fconfigure-task",[3755],[3767],{"type":49,"value":3768},"Task types",{"type":43,"tag":313,"props":3770,"children":3771},{},[3772],{"type":43,"tag":123,"props":3773,"children":3776},{"href":3774,"rel":3775},"https:\u002F\u002Fdocs.databricks.com\u002Fdev-tools\u002Fbundles\u002F",[3755],[3777],{"type":49,"value":3778},"Declarative Automation Bundles",{"type":43,"tag":313,"props":3780,"children":3781},{},[3782],{"type":43,"tag":123,"props":3783,"children":3786},{"href":3784,"rel":3785},"https:\u002F\u002Fdocs.databricks.com\u002Fapi\u002Fworkspace\u002Fjobs",[3755],[3787],{"type":49,"value":3788},"Jobs API Reference",{"type":43,"tag":313,"props":3790,"children":3791},{},[3792],{"type":43,"tag":123,"props":3793,"children":3796},{"href":3794,"rel":3795},"https:\u002F\u002Fgithub.com\u002Fdatabricks\u002Fbundle-examples",[3755],[3797],{"type":49,"value":3798},"Bundle Examples Repository",{"type":43,"tag":3800,"props":3801,"children":3802},"style",{},[3803],{"type":49,"value":3804},"html .light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html.light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"items":3806,"total":3985},[3807,3824,3838,3853,3870,3890,3901,3923,3934,3948,3961,3974],{"slug":3808,"name":3808,"fn":3809,"description":3810,"org":3811,"tags":3812,"stars":23,"repoUrl":24,"updatedAt":3823},"databricks-agent-bricks","create Databricks Agent Bricks","Create Agent Bricks: Knowledge Assistants (KA) for document Q&A and Supervisor Agents for multi-agent orchestration (MAS).",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3813,3816,3817,3820],{"name":3814,"slug":3815,"type":15},"Agents","agents",{"name":9,"slug":8,"type":15},{"name":3818,"slug":3819,"type":15},"Knowledge Management","knowledge-management",{"name":3821,"slug":3822,"type":15},"Multi-Agent","multi-agent","2026-07-15T05:41:38.548954",{"slug":3825,"name":3825,"fn":3826,"description":3827,"org":3828,"tags":3829,"stars":23,"repoUrl":24,"updatedAt":3837},"databricks-ai-functions","use Databricks built-in AI functions","Use Databricks built-in AI Functions (ai_classify, ai_extract, ai_summarize, ai_mask, ai_translate, ai_fix_grammar, ai_gen, ai_analyze_sentiment, ai_similarity, ai_parse_document, ai_prep_search, ai_query, ai_forecast) to add AI capabilities directly to SQL and PySpark pipelines without managing model endpoints. Also covers document parsing and building custom RAG pipelines (parse → prep_search → index → query).",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3830,3833,3834],{"name":3831,"slug":3832,"type":15},"Data Analysis","data-analysis",{"name":9,"slug":8,"type":15},{"name":3835,"slug":3836,"type":15},"LLM","llm","2026-07-31T05:53:33.562077",{"slug":3839,"name":3839,"fn":3840,"description":3841,"org":3842,"tags":3843,"stars":23,"repoUrl":24,"updatedAt":3852},"databricks-ai-runtime","submit and manage Databricks GPU workloads","Databricks AI Runtime (`air`) CLI — the command-line tool for submitting and managing GPU training workloads on Databricks serverless compute. Use for: running `air` workloads, custom Docker image setup, environment configuration, and troubleshooting `air` jobs.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3844,3845,3846,3849],{"name":711,"slug":708,"type":15},{"name":9,"slug":8,"type":15},{"name":3847,"slug":3848,"type":15},"Docker","docker",{"name":3850,"slug":3851,"type":15},"Engineering","engineering","2026-07-12T08:04:55.843982",{"slug":3854,"name":3854,"fn":3855,"description":3856,"org":3857,"tags":3858,"stars":23,"repoUrl":24,"updatedAt":3869},"databricks-aibi-dashboards","create Databricks AI\u002FBI dashboards","Create Databricks AI\u002FBI dashboards. Must use when creating, updating, or deploying Lakeview dashboards as Databricks Dashboard have a unique json structure. CRITICAL: You MUST test ALL SQL queries via CLI BEFORE deploying. Follow guidelines strictly.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3859,3862,3865,3868],{"name":3860,"slug":3861,"type":15},"Analytics","analytics",{"name":3863,"slug":3864,"type":15},"Dashboards","dashboards",{"name":3866,"slug":3867,"type":15},"Data Visualization","data-visualization",{"name":9,"slug":8,"type":15},"2026-07-12T08:04:25.314591",{"slug":3871,"name":3871,"fn":3872,"description":3873,"org":3874,"tags":3875,"stars":23,"repoUrl":24,"updatedAt":3889},"databricks-app-design","design UX for Databricks AppKit applications","Design the UX of custom-code Databricks Apps (AppKit\u002FReact) data screens — KPI\u002Foverview pages, reports, charts, tables, and Genie\u002Fchat data assistants — mapped to concrete AppKit components. Use when BUILDING or reviewing the UI of an AppKit\u002FReact app that displays data or answers data questions: choosing genre, layout, charts, KPIs, semantic color, required states (loading\u002Fempty\u002Ferror), IBCS notation, and AI-result trust (showing generated SQL\u002Fsources for Genie\u002Fchat). A plain \"create a dashboard\" request means a managed AI\u002FBI (Lakeview) dashboard → use databricks-aibi-dashboards, NOT this skill. Also NOT for non-data frontend (forms, settings, auth, marketing) or scaffolding\u002Fbuild\u002Fdeploy (→ databricks-apps). Complements databricks-apps; use it alongside whenever a custom app has a chart, table, KPI, report, or Genie\u002Fchat\u002FAI surface.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3876,3877,3880,3883,3886],{"name":9,"slug":8,"type":15},{"name":3878,"slug":3879,"type":15},"Design","design",{"name":3881,"slug":3882,"type":15},"Frontend","frontend",{"name":3884,"slug":3885,"type":15},"React","react",{"name":3887,"slug":3888,"type":15},"UI Components","ui-components","2026-07-12T08:04:02.02398",{"slug":3891,"name":3891,"fn":3892,"description":3893,"org":3894,"tags":3895,"stars":23,"repoUrl":24,"updatedAt":3900},"databricks-apps","build applications on Databricks Apps","Build apps on Databricks Apps platform. Use when asked to create data apps, analytics tools, or custom interactive visualizations. A plain \"create a dashboard\" request means a managed AI\u002FBI (Lakeview) dashboard → use databricks-aibi-dashboards, not this skill. Evaluates data access patterns (analytics vs Lakebase synced tables) before scaffolding. Invoke BEFORE starting implementation.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3896,3897,3898,3899],{"name":3860,"slug":3861,"type":15},{"name":3863,"slug":3864,"type":15},{"name":3831,"slug":3832,"type":15},{"name":9,"slug":8,"type":15},"2026-07-12T08:03:59.061458",{"slug":3902,"name":3902,"fn":3903,"description":3904,"org":3905,"tags":3906,"stars":23,"repoUrl":24,"updatedAt":3922},"databricks-apps-python","build Python backends for Databricks Apps","Python backend for Databricks Apps — FastAPI (default), Flask, Dash, Streamlit, Gradio, Reflex. **Default for a new Databricks App is `databricks-apps` (AppKit — Node\u002FTypeScript\u002FReact) — reach for it first.** Use this skill only when the user asks for a Python backend, extends an existing Python app, or the team is Python-only. Covers OAuth auth, app resources, SQL warehouse and Lakebase connectivity, foundation-model \u002F Vector Search \u002F model-serving APIs (via `databricks-python-sdk`), and deployment via CLI or DABs.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3907,3908,3911,3914,3917,3919],{"name":9,"slug":8,"type":15},{"name":3909,"slug":3910,"type":15},"FastAPI","fastapi",{"name":3912,"slug":3913,"type":15},"Flask","flask",{"name":3915,"slug":3916,"type":15},"Gradio","gradio",{"name":3918,"slug":548,"type":15},"Python",{"name":3920,"slug":3921,"type":15},"Streamlit","streamlit","2026-07-12T08:04:10.970845",{"slug":38,"name":38,"fn":3924,"description":3925,"org":3926,"tags":3927,"stars":23,"repoUrl":24,"updatedAt":3933},"configure Databricks CLI and authentication","Databricks CLI operations and the parent\u002Fentry-point skill for Databricks CLI use: authentication, profile selection, and bundles. Load this first for CLI, auth, profile, and bundle tasks, then load the matching product skill. For finding or exploring data, answering questions about the data, or generating SQL, load the databricks-data-discovery skill (it routes to Genie One). Contains up-to-date guidelines for Databricks-related CLI tasks.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3928,3931,3932],{"name":3929,"slug":3930,"type":15},"Authentication","authentication",{"name":711,"slug":708,"type":15},{"name":9,"slug":8,"type":15},"2026-07-18T05:11:05.45506",{"slug":3721,"name":3721,"fn":3935,"description":3936,"org":3937,"tags":3938,"stars":23,"repoUrl":24,"updatedAt":3947},"manage Databricks Declarative Automation Bundles","Create, configure, validate, deploy, run, and manage Declarative Automation Bundles (DABs, formerly Databricks Asset Bundles). Use when working with Databricks resources via DABs including dashboards, jobs, pipelines, alerts, volumes, and apps.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3939,3942,3945,3946],{"name":3940,"slug":3941,"type":15},"Automation","automation",{"name":3943,"slug":3944,"type":15},"Configuration","configuration",{"name":9,"slug":8,"type":15},{"name":20,"slug":21,"type":15},"2026-07-15T05:41:35.930355",{"slug":3949,"name":3949,"fn":3950,"description":3951,"org":3952,"tags":3953,"stars":23,"repoUrl":24,"updatedAt":3960},"databricks-data-discovery","discover and query Databricks data","Discover, explore, and query Databricks data via Genie — the CLI equivalent of the Genie One MCP. MUST be invoked whenever the user asks to find or locate data ('what tables are in X', 'where does X live', 'which catalog\u002Fschema has Y'), answer a natural-language question about the data, or write a SQL query.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3954,3955,3956,3957],{"name":3831,"slug":3832,"type":15},{"name":13,"slug":14,"type":15},{"name":9,"slug":8,"type":15},{"name":3958,"slug":3959,"type":15},"SQL","sql","2026-07-31T05:53:32.561877",{"slug":3962,"name":3962,"fn":3963,"description":3964,"org":3965,"tags":3966,"stars":23,"repoUrl":24,"updatedAt":3973},"databricks-dbsql","query and script Databricks SQL warehouses","Databricks SQL (DBSQL) advanced features and SQL warehouse capabilities. This skill MUST be invoked when the user mentions: \"DBSQL\", \"Databricks SQL\", \"SQL warehouse\", \"SQL scripting\", \"stored procedure\", \"CALL procedure\", \"materialized view\", \"CREATE MATERIALIZED VIEW\", \"pipe syntax\", \"|>\", \"geospatial\", \"H3\", \"ST_\", \"spatial SQL\", \"collation\", \"COLLATE\", \"ai_query\", \"ai_classify\", \"ai_extract\", \"ai_gen\", \"AI function\", \"http_request\", \"remote_query\", \"read_files\", \"Lakehouse Federation\", \"recursive CTE\", \"WITH RECURSIVE\", \"multi-statement transaction\", \"temp table\", \"temporary view\", \"pipe operator\". SHOULD also invoke when the user asks about SQL best practices, data modeling patterns, or advanced SQL features on Databricks.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3967,3968,3971,3972],{"name":3831,"slug":3832,"type":15},{"name":3969,"slug":3970,"type":15},"Database","database",{"name":9,"slug":8,"type":15},{"name":3958,"slug":3959,"type":15},"2026-07-12T08:04:08.678282",{"slug":3975,"name":3975,"fn":3976,"description":3977,"org":3978,"tags":3979,"stars":23,"repoUrl":24,"updatedAt":3984},"databricks-docs","search Databricks documentation","Databricks documentation reference via llms.txt index. Use when other skills do not cover a topic, looking up unfamiliar Databricks features, or needing authoritative docs on APIs, configurations, or platform capabilities.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3980,3981,3982],{"name":9,"slug":8,"type":15},{"name":3744,"slug":3741,"type":15},{"name":1209,"slug":3983,"type":15},"reference","2026-07-15T05:41:34.697746",31,{"items":3987,"total":3985},[3988,3995,4001,4008,4015,4023,4030],{"slug":3808,"name":3808,"fn":3809,"description":3810,"org":3989,"tags":3990,"stars":23,"repoUrl":24,"updatedAt":3823},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3991,3992,3993,3994],{"name":3814,"slug":3815,"type":15},{"name":9,"slug":8,"type":15},{"name":3818,"slug":3819,"type":15},{"name":3821,"slug":3822,"type":15},{"slug":3825,"name":3825,"fn":3826,"description":3827,"org":3996,"tags":3997,"stars":23,"repoUrl":24,"updatedAt":3837},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3998,3999,4000],{"name":3831,"slug":3832,"type":15},{"name":9,"slug":8,"type":15},{"name":3835,"slug":3836,"type":15},{"slug":3839,"name":3839,"fn":3840,"description":3841,"org":4002,"tags":4003,"stars":23,"repoUrl":24,"updatedAt":3852},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4004,4005,4006,4007],{"name":711,"slug":708,"type":15},{"name":9,"slug":8,"type":15},{"name":3847,"slug":3848,"type":15},{"name":3850,"slug":3851,"type":15},{"slug":3854,"name":3854,"fn":3855,"description":3856,"org":4009,"tags":4010,"stars":23,"repoUrl":24,"updatedAt":3869},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4011,4012,4013,4014],{"name":3860,"slug":3861,"type":15},{"name":3863,"slug":3864,"type":15},{"name":3866,"slug":3867,"type":15},{"name":9,"slug":8,"type":15},{"slug":3871,"name":3871,"fn":3872,"description":3873,"org":4016,"tags":4017,"stars":23,"repoUrl":24,"updatedAt":3889},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4018,4019,4020,4021,4022],{"name":9,"slug":8,"type":15},{"name":3878,"slug":3879,"type":15},{"name":3881,"slug":3882,"type":15},{"name":3884,"slug":3885,"type":15},{"name":3887,"slug":3888,"type":15},{"slug":3891,"name":3891,"fn":3892,"description":3893,"org":4024,"tags":4025,"stars":23,"repoUrl":24,"updatedAt":3900},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4026,4027,4028,4029],{"name":3860,"slug":3861,"type":15},{"name":3863,"slug":3864,"type":15},{"name":3831,"slug":3832,"type":15},{"name":9,"slug":8,"type":15},{"slug":3902,"name":3902,"fn":3903,"description":3904,"org":4031,"tags":4032,"stars":23,"repoUrl":24,"updatedAt":3922},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4033,4034,4035,4036,4037,4038],{"name":9,"slug":8,"type":15},{"name":3909,"slug":3910,"type":15},{"name":3912,"slug":3913,"type":15},{"name":3915,"slug":3916,"type":15},{"name":3918,"slug":548,"type":15},{"name":3920,"slug":3921,"type":15}]