air: include MLflow run and experiment IDs in `air get` JSON by dimk0 · Pull Request #7636 · databricks/cli

dimk0 · 2026-11-14T23:42:52Z

Changes

air get -o json gains mlflow_experiment_id and mlflow_run_id, next to mlflow_url and filled from the same identifiers, so they are null exactly when mlflow_url is. The names match AiRuntimeTaskOutput.mlflow_experiment_id / mlflow_run_id.
Text output, air list, and URL formats are unchanged.

Why

Handing an AIR run to the next step needs its MLflow run ID. For example, the AI Runtime cookbook's serving recipe registers a model from the training run with source_training_run_id=<MLflow run ID>. Today the JSON exposes the ID only inside mlflow_url, and the text view's MLflow Run row shows the run name, so scripts and agents parse URLs. With this change: databricks air get <JOB_RUN_ID> -o json | jq -r .data.mlflow_run_id. Internal ticket: CNXT-2640.

Tests

TestGetRunJSONMLflowIDs: both fields are set when the run output has MLflow IDs and null when it does not, and they are null exactly when mlflow_url is. Fails without the change.
Updated the JSON expectations in TestBuildGetDataTerminationReasonJSON and TestBuildGetDataWaitingForComputeStatus, and the air/get, air/get-ai-runtime and air/get-pending acceptance goldens.
go test ./cmd/air/... and go test ./acceptance -run 'TestAccept/air/' pass; ./task lint-q is clean. Unit tests ran with DATABRICKS_WORKSPACE_ID unset: TestLogsCommandRepeatsRunLinkAfterStreaming also fails on main when that variable is set.

This pull request and its description were written by Isaac.

`air get -o json` exposed the run's MLflow run only through mlflow_url, so handing an AIR run to an MLflow-based next step (e.g. a registration job that takes the MLflow run ID) meant parsing the URL. Add mlflow_experiment_id and mlflow_run_id next to it; they are null exactly when mlflow_url is. Co-authored-by: Isaac <[email protected]>

Co-authored-by: Isaac <[email protected]>

github-actions · 2026-11-14T23:49:31Z

Commit: e21f48dc6 | Workflow run

Regression test report

Selected 3 changed tests (limit=20, 0 not selected)

3 tests: regression=3 unreleased=0 coverage=0 failing=0

test	branch	main (`2699068`)	latest (v1.26.0)
TestAccept/air/get	✅	❌	❌
TestAccept/air/get-ai-runtime	✅	❌	❌
TestAccept/air/get-pending	✅	❌	❌

TestAccept/air/get: branch ✅ | main (2699068) ❌ | latest (v1.26.0) ❌

main (2699068):

acceptance_test.go:1374: Diff:
        --- air/get/output.txt
        +++ /tmp/TestAcceptairget982009407/002/output.txt
        @@ -50,8 +50,6 @@
             "experiment_name": "my-exp",
             "dashboard_url": "[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]",
             "mlflow_url": "[DATABRICKS_URL]/ml/experiments/exp1/runs/run1/logs",
        -    "mlflow_experiment_id": "exp1",
        -    "mlflow_run_id": "run1",
             "est_remaining_seconds": null,
             "est_percent_complete": null
           }

latest (v1.26.0):

acceptance_test.go:1374: Diff:
        --- air/get/output.txt
        +++ /tmp/TestAcceptairget1200739764/002/output.txt
        @@ -49,9 +49,7 @@
             "attempt_number": 0,
             "experiment_name": "my-exp",
             "dashboard_url": "[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]",
        -    "mlflow_url": "[DATABRICKS_URL]/ml/experiments/exp1/runs/run1/logs",
        -    "mlflow_experiment_id": "exp1",
        -    "mlflow_run_id": "run1",
        +    "mlflow_url": "[DATABRICKS_URL]/ml/experiments/exp1/runs/run1/artifacts/logs/node_0",
             "est_remaining_seconds": null,
             "est_percent_complete": null
           }
        
FAIL

TestAccept/air/get-ai-runtime: branch ✅ | main (2699068) ❌ | latest (v1.26.0) ❌

main (2699068):

acceptance_test.go:1374: Diff:
        --- air/get-ai-runtime/output.txt
        +++ /tmp/TestAcceptairget-ai-runtime925844936/002/output.txt
        @@ -50,8 +50,6 @@
             "experiment_name": "my-exp",
             "dashboard_url": "[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]",
             "mlflow_url": "[DATABRICKS_URL]/ml/experiments/exp1/runs/run1/logs",
        -    "mlflow_experiment_id": "exp1",
        -    "mlflow_run_id": "run1",
             "est_remaining_seconds": null,
             "est_percent_complete": null
           }
        
    acceptance_test.go:1152: LOG.import: 
    acceptance_test.go:1152: LOG.mkdirs: 
FAIL

latest (v1.26.0):

acceptance_test.go:1374: Diff:
        --- air/get-ai-runtime/output.txt
        +++ /tmp/TestAcceptairget-ai-runtime1135624377/002/output.txt
        @@ -49,9 +49,7 @@
             "attempt_number": 0,
             "experiment_name": "my-exp",
             "dashboard_url": "[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]",
        -    "mlflow_url": "[DATABRICKS_URL]/ml/experiments/exp1/runs/run1/logs",
        -    "mlflow_experiment_id": "exp1",
        -    "mlflow_run_id": "run1",
        +    "mlflow_url": "[DATABRICKS_URL]/ml/experiments/exp1/runs/run1/artifacts/logs/node_0",
             "est_remaining_seconds": null,
             "est_percent_complete": null
           }
        
    acceptance_test.go:1152: LOG.import: 
    acceptance_test.go:1152: LOG.mkdirs:

TestAccept/air/get-pending: branch ✅ | main (2699068) ❌ | latest (v1.26.0) ❌

main (2699068):

acceptance_test.go:1374: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1374
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1115
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:660
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] air get 123 -o json\n{\n  \"v\": 1,\n  \"ts\": \"[TIMESTAMP]\",\n  \"data\": {\n    \"run_id\": \"123\",\n    \"status\": \"PENDING\",\n    \"started_at\": null,\n    \"duration_seconds\": null,\n    \"attempt_number\": 0,\n    \"experiment_name\": \"my-exp\",\n    \"dashboard_url\": \"[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]\",\n    \"mlflow_url\": null,\n    \"mlflow_experiment_id\": null,\n    \"mlflow_run_id\": null,\n    \"status_message\": \"Waiting for accelerator compute capacity to become available...\",\n    \"est_remaining_seconds\": null,\n    \"est_percent_complete\": null\n  }\n}\n"
        	            	actual  : "\n>>> [CLI] air get 123 -o json\n{\n  \"v\": 1,\n  \"ts\": \"[TIMESTAMP]\",\n  \"data\": {\n    \"run_id\": \"123\",\n    \"status\": \"PENDING\",\n    \"started_at\": null,\n    \"duration_seconds\": null,\n    \"attempt_number\": 0,\n    \"experiment_name\": \"my-exp\",\n    \"dashboard_url\": \"[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]\",\n    \"mlflow_url\": null,\n    \"status_message\": \"Waiting for accelerator compute capacity to become available...\",\n    \"est_remaining_seconds\": null,\n    \"est_percent_complete\": null\n  }\n}\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -14,4 +14,2 @@
        	            	     "mlflow_url": null,
        	            	-    "mlflow_experiment_id": null,
        	            	-    "mlflow_run_id": null,
        	            	     "status_message": "Waiting for accelerator compute capacity to become available...",
        	Test:       	TestAccept/air/get-pending
        	Messages:   	air/get-pending/output.txt vs /tmp/TestAcceptairget-pending1893963194/002/output.txt

latest (v1.26.0):

acceptance_test.go:1374: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1374
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1115
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:660
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] air get 123 -o json\n{\n  \"v\": 1,\n  \"ts\": \"[TIMESTAMP]\",\n  \"data\": {\n    \"run_id\": \"123\",\n    \"status\": \"PENDING\",\n    \"started_at\": null,\n    \"duration_seconds\": null,\n    \"attempt_number\": 0,\n    \"experiment_name\": \"my-exp\",\n    \"dashboard_url\": \"[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]\",\n    \"mlflow_url\": null,\n    \"mlflow_experiment_id\": null,\n    \"mlflow_run_id\": null,\n    \"status_message\": \"Waiting for accelerator compute capacity to become available...\",\n    \"est_remaining_seconds\": null,\n    \"est_percent_complete\": null\n  }\n}\n"
        	            	actual  : "\n>>> [CLI] air get 123 -o json\n{\n  \"v\": 1,\n  \"ts\": \"[TIMESTAMP]\",\n  \"data\": {\n    \"run_id\": \"123\",\n    \"status\": \"RUNNING\",\n    \"started_at\": null,\n    \"duration_seconds\": null,\n    \"attempt_number\": 0,\n    \"experiment_name\": \"my-exp\",\n    \"dashboard_url\": \"[DATABRICKS_URL]/jobs/runs/123?o=[WORKSPACE_ID]\",\n    \"mlflow_url\": null,\n    \"est_remaining_seconds\": null,\n    \"est_percent_complete\": null\n  }\n}\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -7,3 +7,3 @@
        	            	     "run_id": "123",
        	            	-    "status": "PENDING",
        	            	+    "status": "RUNNING",
        	            	     "started_at": null,
        	            	@@ -14,5 +14,2 @@
        	            	     "mlflow_url": null,
        	            	-    "mlflow_experiment_id": null,
        	            	-    "mlflow_run_id": null,
        	            	-    "status_message": "Waiting for accelerator compute capacity to become available...",
        	            	     "est_remaining_seconds": null,
        	Test:       	TestAccept/air/get-pending
        	Messages:   	air/get-pending/output.txt vs /tmp/TestAcceptairget-pending3808601123/002/output.txt

eng-dev-ecosystem-bot · 2026-11-15T00:06:56Z

✅ Integration test report

Commit: e21f48d

Run: 43654811317

	Env	✅pass	🙈skip	Time
✅	aws linux-2core-8gb	271	18	3:44
✅	aws-windows-latest-4core-16gb	273	16	3:33
✅	azure linux-2core-8gb	270	18	3:44
✅	azure-windows-latest-4core-16gb	272	16	4:50
✅	gcp linux-2core-8gb	271	18	3:36
✅	gcp-windows-latest-4core-16gb	273	16	3:52

Top 3 slowest tests (at least 2 minutes):

duration	env	testname
4:42	azure-windows-latest-4core-16gb	TestAccept
3:47	gcp-windows-latest-4core-16gb	TestAccept
3:28	aws-windows-latest-4core-16gb	TestAccept

dimk0 and others added 2 commits November 14, 2026 23:42

Add changelog entry

e21f48d

Co-authored-by: Isaac <[email protected]>

github-actions Bot added the AIR Databricks AI Runtime CLI label Nov 14, 2026

Navigation Menu

Repository navigation

air: include MLflow run and experiment IDs in `air get` JSON - #7636

air: include MLflow run and experiment IDs in `air get` JSON#7636
dimk0 wants to merge 2 commits into
mainfrom
cnxt-2640-air-get-mlflow-run-id

dimk0 commented Nov 14, 2026

Uh oh!

github-actions Bot commented Nov 14, 2026

Uh oh!

eng-dev-ecosystem-bot commented Nov 15, 2026

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

dimk0 commented Nov 14, 2026

Changes

Why

Tests

Uh oh!

github-actions Bot commented Nov 14, 2026

Regression test report

Uh oh!

eng-dev-ecosystem-bot commented Nov 15, 2026

✅ Integration test report

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants