
Description
Connect to SageMaker Managed MLflow (mlflow-app or mlflow-tracking-server ARN) as an MLflow backend, then hand off to the other MLflow skills. Triggers on a SageMaker MLflow ARN (arn:aws:sagemaker:...:mlflow-app/... or arn:aws:sagemaker:...:mlflow-tracking-server/...) or "SageMaker Managed MLflow".
SKILL.md
Connect to SageMaker MLflow
Establishes the connection to SageMaker Managed MLflow (the sagemaker-mlflow plugin + an
ARN tracking URI + AWS credentials), then hands off to the requested MLflow skill
(instrumenting-with-mlflow-tracing, agent-evaluation, retrieving-mlflow-traces,
querying-mlflow-metrics, etc.), which inherit the connection via MLFLOW_TRACKING_URI.
Requires Python >= 3.10 (mlflow >= 3.8). Validate and report the fix — never auto-install the plugin or acquire credentials (mirrors the repo's Databricks pattern).
Step 1: Preconditions
python --version-> must be 3.10+. If older, STOP and tell the user.- Confirm AWS credentials resolve (env vars,
aws configure/ SSO, or an IAM role). If they error (ExpiredToken / no creds), STOP and ask the user to configure them. (scripts/verify_connection.pyalso checks this, via boto3.)
Step 2: Install the plugin
pip install sagemaker-mlflow
Required even if MLFLOW_TRACKING_URI is already an ARN — without it,
mlflow.set_tracking_uri() fails with UnsupportedModelRegistryStoreURIException.
Step 3: Select the resource ARN
- If the user already provided an ARN (or
MLFLOW_TRACKING_URIis set toarn:aws:sagemaker:...), use it as-is. - Otherwise, discover it in the user's region:
If exactly one is returned, use it; if several, list name/status/ARN and ask the user which to use. Both
python scripts/discover_arns.pymlflow-appandmlflow-tracking-serverARNs work; the ARN is also shown on the resource's detail page in the SageMaker Studio console.
Then export it (the ARN is region-bound — a cross-region ARN will not authenticate):
export MLFLOW_TRACKING_URI="<arn>" # mlflow-app/<id> or mlflow-tracking-server/<name>
export AWS_DEFAULT_REGION="<region>" # AWS credentials resolved via the default chain (SigV4)
Step 4: Verify
python scripts/verify_connection.py "$MLFLOW_TRACKING_URI"
Checks all three prerequisites (plugin / credentials / ARN connectivity) and exits non-zero with a remediation hint on the first failure. Do not proceed until it passes.
After the connection verifies, hand off to the requested MLflow skill — it inherits the
connected environment via MLFLOW_TRACKING_URI.
Troubleshooting
UnsupportedModelRegistryStoreURIException— thesagemaker-mlflowplugin is not installed;pip install sagemaker-mlflow, then re-runscripts/verify_connection.py.AccessDenied/403— credentials are missing/expired, or the principal lacks MLflow permissions on the ARN. Check that credentials resolve, grantsagemaker-mlflow/sagemakerpermissions, and confirm the ARN region matchesAWS_DEFAULT_REGION.
More skills from the skills repository
View all 10 skillsagent-evaluation
evaluate and optimize LLM agent output
Jul 14AgentsEvalsMLflowPerformanceanalyzing-mlflow-session
analyze MLflow chat conversation sessions
Jul 14DebuggingMLflowObservabilityTracinganalyzing-mlflow-trace
analyze MLflow traces
Jul 14DebuggingMLflowObservabilityTracinginstrumenting-with-mlflow-tracing
instrument Python and TypeScript with MLflow Tracing
Jul 20AgentsEvalsMLflowObservability +3mlflow-agent
dispatch MLflow workflows and agent tasks
Jul 14AgentsMLflowMLOpsTracingmlflow-onboarding
onboard users to MLflow workflows
Jul 14MLflowMLOpsOnboarding
More from MLflow
View publishersetup
configure MLflow tracing
mlflow
Jul 14Claude CodeMLflowTracingstatus
display MLflow tracing configuration
mlflow
Jul 14Claude CodeMLflowTracingquerying-mlflow-metrics
fetch trace metrics from MLflow servers
skills
Jul 14AnalyticsMetricsMLflowObservabilityretrieving-mlflow-traces
retrieve and query MLflow traces
skills
Jul 14DebuggingMLflowObservabilityTracingsearching-mlflow-docs
search and retrieve MLflow documentation
skills
Jul 14DocumentationMLflowReference