[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill-launchdarkly-launchdarkly-experiment-setup":3,"mdc-vo4vqx-key":40,"related-org-launchdarkly-launchdarkly-experiment-setup":3830,"related-repo-launchdarkly-launchdarkly-experiment-setup":3960},{"slug":4,"name":4,"fn":5,"description":6,"org":7,"tags":11,"stars":26,"repoUrl":27,"updatedAt":28,"license":29,"forks":30,"topics":31,"repo":35,"sourceUrl":38,"mdContent":39},"launchdarkly-experiment-setup","run experiments in LaunchDarkly","Set up and run experiments in LaunchDarkly. Create experiments with metrics, treatments, and flag config, start iterations to collect data, swap design between iterations, and stop with a winner.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},"launchdarkly","LaunchDarkly","https:\u002F\u002Fpexgzepcugksgbtrxkhf.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Forg-logos\u002Flaunchdarkly.png",[12,16,19,22,23],{"name":13,"slug":14,"type":15},"Feature Flags","feature-flags","tag",{"name":17,"slug":18,"type":15},"Product Management","product-management",{"name":20,"slug":21,"type":15},"Analytics","analytics",{"name":9,"slug":8,"type":15},{"name":24,"slug":25,"type":15},"A\u002FB Testing","a-b-testing",20,"https:\u002F\u002Fgithub.com\u002Flaunchdarkly\u002Fai-tooling","2026-05-08T05:10:25.912399","Apache-2.0",6,[32,33,34],"agent-skills","launchdarkly-ai","managed-by-terraform",{"repoUrl":27,"stars":26,"forks":30,"topics":36,"description":37},[32,33,34],"LaunchDarkly's official AI tooling","https:\u002F\u002Fgithub.com\u002Flaunchdarkly\u002Fai-tooling\u002Ftree\u002FHEAD\u002Fskills\u002Fexperiments\u002Flaunchdarkly-experiment-setup","---\nname: launchdarkly-experiment-setup\ndescription: \"Set up and run experiments in LaunchDarkly. Create experiments with metrics, treatments, and flag config, start iterations to collect data, swap design between iterations, and stop with a winner.\"\nlicense: Apache-2.0\ncompatibility: Requires the remotely hosted LaunchDarkly MCP server\nmetadata:\n  author: launchdarkly\n  version: \"0.2.0\"\n---\n\n# LaunchDarkly Experiment Setup\n\nYou're using a skill that guides you through setting up and running experiments in LaunchDarkly. Your job is to design the experiment, create it with the right metrics, treatments, and flag config, start data collection, evolve the design between iterations when needed, and stop with a winner.\n\n## Prerequisites\n\nThis skill requires the remotely hosted LaunchDarkly MCP server to be configured in your environment.\n\n**Required MCP tools:**\n- `create-experiment` — create a new experiment with its initial iteration (hypothesis, metrics, treatments, flag config).\n- `start-experiment-iteration` — begin collecting data for an experiment's current draft iteration.\n- `get-experiment` — check experiment status, treatments, metrics, and current iteration.\n\n**Optional MCP tools:**\n- `list-experiments` — browse existing experiments in the project.\n- `update-experiment` — update fields on the experiment or its current iteration. Honours `mutableFieldsByStatus`, so what's editable depends on whether the iteration is `not_started`, `running`, or `stopped`. Returns rejected inputs under `skipped`.\n- `save-and-start-experiment-iteration` — the API-recommended way to change locked fields on a running experiment. Stops the current iteration, creates a new draft with the supplied field updates, and starts it in one call.\n- `stop-experiment-iteration` — stop the running iteration. You must declare a winner: pass the `winningTreatmentId` (and a `winningReason`). If no variation outperformed, pick the baseline\u002Fcontrol as the winner.\n- `list-metrics`, `create-metric`, `list-metric-events` — manage metrics referenced by the experiment.\n\n## Core Concepts\n\n### What Are Experiments?\n\nExperiments in LaunchDarkly measure the impact of feature flag variations on key metrics. An experiment consists of:\n\n- **Treatments**: the flag variations being compared (control vs. test). Each treatment has an `allocationPercent`; the values across treatments should sum to 100.\n- **Metrics**: what you're measuring (conversion rate, latency, revenue, etc.). One must be the primary metric.\n- **Flag config**: the `flagKey`, `ruleId`, and `flagConfigVersion` of the targeting rule that drives the experiment.\n- **Iteration**: a single data-collection window. Created in `not_started` status, becomes `running` when started, transitions to `stopped` when ended.\n- **Holdout** (optional): a project-level group of users excluded from the experiment for baseline measurement (`holdoutId`).\n\n### Experiment Lifecycle\n\n1. **Create** the experiment with its first iteration (`create-experiment`).\n2. **Start the iteration** to begin data collection (`start-experiment-iteration`).\n3. **Monitor** results as data accumulates (`get-experiment`).\n4. **Evolve the design** mid-experiment if needed — change locked fields like `treatments`, `metrics`, or `methodology` by calling `save-and-start-experiment-iteration`, which stops the current iteration, creates a new draft with your changes, and starts it.\n5. **Stop the iteration** when you have a winner or a clear call (`stop-experiment-iteration`).\n6. **Ship** the winning variation.\n\n## Core Principles\n\n1. **Metrics first**: ensure the metrics you'll reference exist before creating the experiment.\n2. **Clear hypothesis**: every iteration requires a `hypothesis` string; state what you expect to improve and by how much.\n3. **Proper controls**: exactly one treatment must have `baseline: true`.\n4. **Sufficient sample size**: let iterations run long enough for statistical significance.\n5. **One change at a time**: test one variable per experiment for clear attribution.\n\n## Workflow\n\n### Step 1: Prepare Metrics\n\n1. Use `list-metrics` to find existing metrics.\n2. If you need a new one, use `create-metric` and note the key.\n3. Decide which is the **primary metric** (a single metric or a funnel group). You'll pass its key as `primarySingleMetricKey` or `primaryFunnelKey` on the iteration.\n\n| Goal | Metric type | Example key |\n|------|-------------|-------------|\n| Conversion | Custom conversion | `checkout-completed` |\n| Performance | Custom numeric | `page-load-time-ms` |\n| Engagement | Custom conversion | `feature-clicked` |\n| Revenue | Custom numeric | `order-value` |\n\n### Step 2: Identify the Targeting Rule\n\nYou need the `ruleId` and current `flagConfigVersion` of the flag rule that will drive the experiment. Use `get-flag` on the flag (or its environment-scoped status) to find them. The fallthrough rule's id is the string `\"fallthrough\"`.\n\n### Step 3: Create the Experiment\n\nCall `create-experiment`. The top-level fields describe the experiment; the nested `iteration` object describes the first data-collection window.\n\n```json\n{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"key\": \"checkout-flow-v2-experiment\",\n  \"name\": \"Checkout Flow v2 Experiment\",\n  \"description\": \"Compare the redesigned checkout against the current flow.\",\n  \"tags\": [\"growth\", \"checkout\"],\n  \"methodology\": \"bayesian\",\n  \"iteration\": {\n    \"hypothesis\": \"The redesigned checkout will lift completion rate by 3%.\",\n    \"primarySingleMetricKey\": \"checkout-completed\",\n    \"metrics\": [\n      { \"key\": \"checkout-completed\" },\n      { \"key\": \"checkout-time-seconds\" }\n    ],\n    \"treatments\": [\n      {\n        \"name\": \"Control\",\n        \"baseline\": true,\n        \"allocationPercent\": 50,\n        \"parameters\": [\n          { \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-a-id\" }\n        ]\n      },\n      {\n        \"name\": \"New Checkout\",\n        \"baseline\": false,\n        \"allocationPercent\": 50,\n        \"parameters\": [\n          { \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-b-id\" }\n        ]\n      }\n    ],\n    \"flags\": {\n      \"checkout-flow-v2\": {\n        \"ruleId\": \"fallthrough\",\n        \"flagConfigVersion\": 7\n      }\n    },\n    \"randomizationUnit\": \"user\"\n  }\n}\n```\n\nUseful optional top-level fields:\n- `holdoutId` — attach an existing holdout.\n- `dataSource` — `\"launchdarkly\"` (default), `\"snowflake\"`, or `\"databricks\"`.\n- `methodology` — `\"bayesian\"` (default), `\"frequentist\"`, or `\"export_only\"`.\n- `analysisConfig` — set thresholds, multiple-comparison correction, or sequential testing.\n\nUseful optional iteration fields:\n- `attributes` — array of context attribute keys to slice results by (e.g. `[\"country\", \"device\"]`).\n- `covariateId` — covariate CSV id for stratified sampling.\n- `canReshuffleTraffic` — defaults to `true`; set `false` to lock users to their initial variation when allocations change.\n\n### Step 4: Start Data Collection\n\n```json\n{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"experimentKey\": \"checkout-flow-v2-experiment\"\n}\n```\n\nBefore starting, the API requires that:\n- the flag is toggled on,\n- the iteration has a `randomizationUnit`, and\n- at least one treatment has a non-zero `allocationPercent`.\n\nPass `changeJustification` if you're restarting after a prior iteration was stopped.\n\n### Step 5: Verify\n\n1. Call `get-experiment` and confirm `currentIteration.status === \"running\"`.\n2. Check that treatments are present with the expected allocations.\n3. Check the metric list and the primary metric.\n\n### Step 6: Evolve the Design Mid-Experiment (when needed)\n\nMost structural fields (treatments, metrics, methodology, hypothesis, …) are locked while an iteration is `running`. Two ways to change them:\n\n- **Light edits while running** — `update-experiment` will let through anything `mutableFieldsByStatus` permits in the `running` state (typically just metadata like `name`, `description`, `maintainerId`, `tags`, plus appending `metrics`\u002F`attributes`). It surfaces rejected fields under `skipped` with a reason.\n- **Real design changes** — call `save-and-start-experiment-iteration`. It stops the current iteration, creates a new draft with the supplied field updates applied, and starts it in one call. Inputs match `update-experiment`, plus `changeJustification`. Mutability is checked against `not_started` since updates land on the new draft.\n\nExample: swap the treatment allocation and add a metric in a single call.\n\n```json\n{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"experimentKey\": \"checkout-flow-v2-experiment\",\n  \"changeJustification\": \"Lowering control allocation now that variant looks safe.\",\n  \"treatments\": [\n    {\n      \"name\": \"Control\",\n      \"baseline\": true,\n      \"allocationPercent\": 30,\n      \"parameters\": [{ \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-a-id\" }]\n    },\n    {\n      \"name\": \"New Checkout\",\n      \"baseline\": false,\n      \"allocationPercent\": 70,\n      \"parameters\": [{ \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-b-id\" }]\n    }\n  ],\n  \"metrics\": [\n    { \"key\": \"checkout-completed\" },\n    { \"key\": \"checkout-time-seconds\" },\n    { \"key\": \"checkout-error-rate\" }\n  ]\n}\n```\n\n### Step 7: Stop the Iteration\n\nWhen you've reached significance or made a call, stop the iteration. **A winning treatment is required to stop** — LaunchDarkly does not let you end an iteration without declaring a winner. Pass the winning treatment's id (returned in `get-experiment` as `_id` on each treatment) plus a `winningReason`.\n\nIf the experiment was inconclusive or no variation beat the control, declare the **baseline\u002Fcontrol treatment as the winner** and say so in `winningReason` (e.g. \"Inconclusive — no significant lift, keeping control\"). There is no \"stop without a winner\" path.\n\n```json\n{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"experimentKey\": \"checkout-flow-v2-experiment\",\n  \"winningTreatmentId\": \"treat-002\",\n  \"winningReason\": \"Two weeks of data, +4.1% lift on the primary metric with PBBL > 95%.\"\n}\n```\n\n**Report results:**\n- Iteration stopped with the declared `winningTreatmentId` (the control\u002Fbaseline if inconclusive).\n- Lift \u002F significance summary on the primary metric.\n- Next steps (ship the winner, roll back, or start a follow-up iteration).\n\n## Edge Cases\n\n| Situation | Action |\n|-----------|--------|\n| Metric doesn't exist | Create it first with `create-metric`. |\n| Flag has no variations to compare | Create flag variations before designing treatments. |\n| You don't know the flag's `ruleId` \u002F `flagConfigVersion` | Use `get-flag` or `get-flag-status-across-envs`. The fallthrough rule's id is the string `\"fallthrough\"`. |\n| Experiment already exists | Use `list-experiments` to find it; `get-experiment` for details. |\n| Need to change locked fields mid-experiment | Use `save-and-start-experiment-iteration` (single call) rather than stopping and recreating by hand. |\n| `update-experiment` returns `skipped` for a field | Inspect the `currentStatus` and `allowedFields` in the response — that field isn't mutable in the current iteration status. Either stop the iteration first or use `save-and-start-experiment-iteration`. |\n\n## What NOT to Do\n\n- Don't omit `iteration` on `create-experiment` — it's required.\n- Don't set `baseline: true` on more than one treatment.\n- Don't let `allocationPercent` values fail to sum to 100 across treatments.\n- Don't try to change locked iteration fields with `update-experiment` while the iteration is `running` — reach for `save-and-start-experiment-iteration` instead.\n- Don't stop iterations early — wait for statistical significance.\n- Don't run multiple experiments on the same flag at the same time without a careful holdout design.\n",{"data":41,"body":45},{"name":4,"description":6,"license":29,"compatibility":42,"metadata":43},"Requires the remotely hosted LaunchDarkly MCP server",{"author":8,"version":44},"0.2.0",{"type":46,"children":47},"root",[48,56,62,69,74,83,122,130,258,264,271,276,389,395,512,518,586,592,598,653,772,778,812,818,838,2022,2027,2114,2119,2178,2184,2307,2312,2343,2356,2362,2393,2399,2411,2529,2534,3255,3261,3294,3313,3507,3515,3540,3546,3736,3742,3824],{"type":49,"tag":50,"props":51,"children":52},"element","h1",{"id":4},[53],{"type":54,"value":55},"text","LaunchDarkly Experiment Setup",{"type":49,"tag":57,"props":58,"children":59},"p",{},[60],{"type":54,"value":61},"You're using a skill that guides you through setting up and running experiments in LaunchDarkly. Your job is to design the experiment, create it with the right metrics, treatments, and flag config, start data collection, evolve the design between iterations when needed, and stop with a winner.",{"type":49,"tag":63,"props":64,"children":66},"h2",{"id":65},"prerequisites",[67],{"type":54,"value":68},"Prerequisites",{"type":49,"tag":57,"props":70,"children":71},{},[72],{"type":54,"value":73},"This skill requires the remotely hosted LaunchDarkly MCP server to be configured in your environment.",{"type":49,"tag":57,"props":75,"children":76},{},[77],{"type":49,"tag":78,"props":79,"children":80},"strong",{},[81],{"type":54,"value":82},"Required MCP tools:",{"type":49,"tag":84,"props":85,"children":86},"ul",{},[87,100,111],{"type":49,"tag":88,"props":89,"children":90},"li",{},[91,98],{"type":49,"tag":92,"props":93,"children":95},"code",{"className":94},[],[96],{"type":54,"value":97},"create-experiment",{"type":54,"value":99}," — create a new experiment with its initial iteration (hypothesis, metrics, treatments, flag config).",{"type":49,"tag":88,"props":101,"children":102},{},[103,109],{"type":49,"tag":92,"props":104,"children":106},{"className":105},[],[107],{"type":54,"value":108},"start-experiment-iteration",{"type":54,"value":110}," — begin collecting data for an experiment's current draft iteration.",{"type":49,"tag":88,"props":112,"children":113},{},[114,120],{"type":49,"tag":92,"props":115,"children":117},{"className":116},[],[118],{"type":54,"value":119},"get-experiment",{"type":54,"value":121}," — check experiment status, treatments, metrics, and current iteration.",{"type":49,"tag":57,"props":123,"children":124},{},[125],{"type":49,"tag":78,"props":126,"children":127},{},[128],{"type":54,"value":129},"Optional MCP tools:",{"type":49,"tag":84,"props":131,"children":132},{},[133,144,195,206,233],{"type":49,"tag":88,"props":134,"children":135},{},[136,142],{"type":49,"tag":92,"props":137,"children":139},{"className":138},[],[140],{"type":54,"value":141},"list-experiments",{"type":54,"value":143}," — browse existing experiments in the project.",{"type":49,"tag":88,"props":145,"children":146},{},[147,153,155,161,163,169,171,177,179,185,187,193],{"type":49,"tag":92,"props":148,"children":150},{"className":149},[],[151],{"type":54,"value":152},"update-experiment",{"type":54,"value":154}," — update fields on the experiment or its current iteration. Honours ",{"type":49,"tag":92,"props":156,"children":158},{"className":157},[],[159],{"type":54,"value":160},"mutableFieldsByStatus",{"type":54,"value":162},", so what's editable depends on whether the iteration is ",{"type":49,"tag":92,"props":164,"children":166},{"className":165},[],[167],{"type":54,"value":168},"not_started",{"type":54,"value":170},", ",{"type":49,"tag":92,"props":172,"children":174},{"className":173},[],[175],{"type":54,"value":176},"running",{"type":54,"value":178},", or ",{"type":49,"tag":92,"props":180,"children":182},{"className":181},[],[183],{"type":54,"value":184},"stopped",{"type":54,"value":186},". Returns rejected inputs under ",{"type":49,"tag":92,"props":188,"children":190},{"className":189},[],[191],{"type":54,"value":192},"skipped",{"type":54,"value":194},".",{"type":49,"tag":88,"props":196,"children":197},{},[198,204],{"type":49,"tag":92,"props":199,"children":201},{"className":200},[],[202],{"type":54,"value":203},"save-and-start-experiment-iteration",{"type":54,"value":205}," — the API-recommended way to change locked fields on a running experiment. Stops the current iteration, creates a new draft with the supplied field updates, and starts it in one call.",{"type":49,"tag":88,"props":207,"children":208},{},[209,215,217,223,225,231],{"type":49,"tag":92,"props":210,"children":212},{"className":211},[],[213],{"type":54,"value":214},"stop-experiment-iteration",{"type":54,"value":216}," — stop the running iteration. You must declare a winner: pass the ",{"type":49,"tag":92,"props":218,"children":220},{"className":219},[],[221],{"type":54,"value":222},"winningTreatmentId",{"type":54,"value":224}," (and a ",{"type":49,"tag":92,"props":226,"children":228},{"className":227},[],[229],{"type":54,"value":230},"winningReason",{"type":54,"value":232},"). If no variation outperformed, pick the baseline\u002Fcontrol as the winner.",{"type":49,"tag":88,"props":234,"children":235},{},[236,242,243,249,250,256],{"type":49,"tag":92,"props":237,"children":239},{"className":238},[],[240],{"type":54,"value":241},"list-metrics",{"type":54,"value":170},{"type":49,"tag":92,"props":244,"children":246},{"className":245},[],[247],{"type":54,"value":248},"create-metric",{"type":54,"value":170},{"type":49,"tag":92,"props":251,"children":253},{"className":252},[],[254],{"type":54,"value":255},"list-metric-events",{"type":54,"value":257}," — manage metrics referenced by the experiment.",{"type":49,"tag":63,"props":259,"children":261},{"id":260},"core-concepts",[262],{"type":54,"value":263},"Core Concepts",{"type":49,"tag":265,"props":266,"children":268},"h3",{"id":267},"what-are-experiments",[269],{"type":54,"value":270},"What Are Experiments?",{"type":49,"tag":57,"props":272,"children":273},{},[274],{"type":54,"value":275},"Experiments in LaunchDarkly measure the impact of feature flag variations on key metrics. An experiment consists of:",{"type":49,"tag":84,"props":277,"children":278},{},[279,297,307,340,371],{"type":49,"tag":88,"props":280,"children":281},{},[282,287,289,295],{"type":49,"tag":78,"props":283,"children":284},{},[285],{"type":54,"value":286},"Treatments",{"type":54,"value":288},": the flag variations being compared (control vs. test). Each treatment has an ",{"type":49,"tag":92,"props":290,"children":292},{"className":291},[],[293],{"type":54,"value":294},"allocationPercent",{"type":54,"value":296},"; the values across treatments should sum to 100.",{"type":49,"tag":88,"props":298,"children":299},{},[300,305],{"type":49,"tag":78,"props":301,"children":302},{},[303],{"type":54,"value":304},"Metrics",{"type":54,"value":306},": what you're measuring (conversion rate, latency, revenue, etc.). One must be the primary metric.",{"type":49,"tag":88,"props":308,"children":309},{},[310,315,317,323,324,330,332,338],{"type":49,"tag":78,"props":311,"children":312},{},[313],{"type":54,"value":314},"Flag config",{"type":54,"value":316},": the ",{"type":49,"tag":92,"props":318,"children":320},{"className":319},[],[321],{"type":54,"value":322},"flagKey",{"type":54,"value":170},{"type":49,"tag":92,"props":325,"children":327},{"className":326},[],[328],{"type":54,"value":329},"ruleId",{"type":54,"value":331},", and ",{"type":49,"tag":92,"props":333,"children":335},{"className":334},[],[336],{"type":54,"value":337},"flagConfigVersion",{"type":54,"value":339}," of the targeting rule that drives the experiment.",{"type":49,"tag":88,"props":341,"children":342},{},[343,348,350,355,357,362,364,369],{"type":49,"tag":78,"props":344,"children":345},{},[346],{"type":54,"value":347},"Iteration",{"type":54,"value":349},": a single data-collection window. Created in ",{"type":49,"tag":92,"props":351,"children":353},{"className":352},[],[354],{"type":54,"value":168},{"type":54,"value":356}," status, becomes ",{"type":49,"tag":92,"props":358,"children":360},{"className":359},[],[361],{"type":54,"value":176},{"type":54,"value":363}," when started, transitions to ",{"type":49,"tag":92,"props":365,"children":367},{"className":366},[],[368],{"type":54,"value":184},{"type":54,"value":370}," when ended.",{"type":49,"tag":88,"props":372,"children":373},{},[374,379,381,387],{"type":49,"tag":78,"props":375,"children":376},{},[377],{"type":54,"value":378},"Holdout",{"type":54,"value":380}," (optional): a project-level group of users excluded from the experiment for baseline measurement (",{"type":49,"tag":92,"props":382,"children":384},{"className":383},[],[385],{"type":54,"value":386},"holdoutId",{"type":54,"value":388},").",{"type":49,"tag":265,"props":390,"children":392},{"id":391},"experiment-lifecycle",[393],{"type":54,"value":394},"Experiment Lifecycle",{"type":49,"tag":396,"props":397,"children":398},"ol",{},[399,415,431,447,486,502],{"type":49,"tag":88,"props":400,"children":401},{},[402,407,409,414],{"type":49,"tag":78,"props":403,"children":404},{},[405],{"type":54,"value":406},"Create",{"type":54,"value":408}," the experiment with its first iteration (",{"type":49,"tag":92,"props":410,"children":412},{"className":411},[],[413],{"type":54,"value":97},{"type":54,"value":388},{"type":49,"tag":88,"props":416,"children":417},{},[418,423,425,430],{"type":49,"tag":78,"props":419,"children":420},{},[421],{"type":54,"value":422},"Start the iteration",{"type":54,"value":424}," to begin data collection (",{"type":49,"tag":92,"props":426,"children":428},{"className":427},[],[429],{"type":54,"value":108},{"type":54,"value":388},{"type":49,"tag":88,"props":432,"children":433},{},[434,439,441,446],{"type":49,"tag":78,"props":435,"children":436},{},[437],{"type":54,"value":438},"Monitor",{"type":54,"value":440}," results as data accumulates (",{"type":49,"tag":92,"props":442,"children":444},{"className":443},[],[445],{"type":54,"value":119},{"type":54,"value":388},{"type":49,"tag":88,"props":448,"children":449},{},[450,455,457,463,464,470,471,477,479,484],{"type":49,"tag":78,"props":451,"children":452},{},[453],{"type":54,"value":454},"Evolve the design",{"type":54,"value":456}," mid-experiment if needed — change locked fields like ",{"type":49,"tag":92,"props":458,"children":460},{"className":459},[],[461],{"type":54,"value":462},"treatments",{"type":54,"value":170},{"type":49,"tag":92,"props":465,"children":467},{"className":466},[],[468],{"type":54,"value":469},"metrics",{"type":54,"value":178},{"type":49,"tag":92,"props":472,"children":474},{"className":473},[],[475],{"type":54,"value":476},"methodology",{"type":54,"value":478}," by calling ",{"type":49,"tag":92,"props":480,"children":482},{"className":481},[],[483],{"type":54,"value":203},{"type":54,"value":485},", which stops the current iteration, creates a new draft with your changes, and starts it.",{"type":49,"tag":88,"props":487,"children":488},{},[489,494,496,501],{"type":49,"tag":78,"props":490,"children":491},{},[492],{"type":54,"value":493},"Stop the iteration",{"type":54,"value":495}," when you have a winner or a clear call (",{"type":49,"tag":92,"props":497,"children":499},{"className":498},[],[500],{"type":54,"value":214},{"type":54,"value":388},{"type":49,"tag":88,"props":503,"children":504},{},[505,510],{"type":49,"tag":78,"props":506,"children":507},{},[508],{"type":54,"value":509},"Ship",{"type":54,"value":511}," the winning variation.",{"type":49,"tag":63,"props":513,"children":515},{"id":514},"core-principles",[516],{"type":54,"value":517},"Core Principles",{"type":49,"tag":396,"props":519,"children":520},{},[521,531,549,566,576],{"type":49,"tag":88,"props":522,"children":523},{},[524,529],{"type":49,"tag":78,"props":525,"children":526},{},[527],{"type":54,"value":528},"Metrics first",{"type":54,"value":530},": ensure the metrics you'll reference exist before creating the experiment.",{"type":49,"tag":88,"props":532,"children":533},{},[534,539,541,547],{"type":49,"tag":78,"props":535,"children":536},{},[537],{"type":54,"value":538},"Clear hypothesis",{"type":54,"value":540},": every iteration requires a ",{"type":49,"tag":92,"props":542,"children":544},{"className":543},[],[545],{"type":54,"value":546},"hypothesis",{"type":54,"value":548}," string; state what you expect to improve and by how much.",{"type":49,"tag":88,"props":550,"children":551},{},[552,557,559,565],{"type":49,"tag":78,"props":553,"children":554},{},[555],{"type":54,"value":556},"Proper controls",{"type":54,"value":558},": exactly one treatment must have ",{"type":49,"tag":92,"props":560,"children":562},{"className":561},[],[563],{"type":54,"value":564},"baseline: true",{"type":54,"value":194},{"type":49,"tag":88,"props":567,"children":568},{},[569,574],{"type":49,"tag":78,"props":570,"children":571},{},[572],{"type":54,"value":573},"Sufficient sample size",{"type":54,"value":575},": let iterations run long enough for statistical significance.",{"type":49,"tag":88,"props":577,"children":578},{},[579,584],{"type":49,"tag":78,"props":580,"children":581},{},[582],{"type":54,"value":583},"One change at a time",{"type":54,"value":585},": test one variable per experiment for clear attribution.",{"type":49,"tag":63,"props":587,"children":589},{"id":588},"workflow",[590],{"type":54,"value":591},"Workflow",{"type":49,"tag":265,"props":593,"children":595},{"id":594},"step-1-prepare-metrics",[596],{"type":54,"value":597},"Step 1: Prepare Metrics",{"type":49,"tag":396,"props":599,"children":600},{},[601,613,625],{"type":49,"tag":88,"props":602,"children":603},{},[604,606,611],{"type":54,"value":605},"Use ",{"type":49,"tag":92,"props":607,"children":609},{"className":608},[],[610],{"type":54,"value":241},{"type":54,"value":612}," to find existing metrics.",{"type":49,"tag":88,"props":614,"children":615},{},[616,618,623],{"type":54,"value":617},"If you need a new one, use ",{"type":49,"tag":92,"props":619,"children":621},{"className":620},[],[622],{"type":54,"value":248},{"type":54,"value":624}," and note the key.",{"type":49,"tag":88,"props":626,"children":627},{},[628,630,635,637,643,645,651],{"type":54,"value":629},"Decide which is the ",{"type":49,"tag":78,"props":631,"children":632},{},[633],{"type":54,"value":634},"primary metric",{"type":54,"value":636}," (a single metric or a funnel group). You'll pass its key as ",{"type":49,"tag":92,"props":638,"children":640},{"className":639},[],[641],{"type":54,"value":642},"primarySingleMetricKey",{"type":54,"value":644}," or ",{"type":49,"tag":92,"props":646,"children":648},{"className":647},[],[649],{"type":54,"value":650},"primaryFunnelKey",{"type":54,"value":652}," on the iteration.",{"type":49,"tag":654,"props":655,"children":656},"table",{},[657,681],{"type":49,"tag":658,"props":659,"children":660},"thead",{},[661],{"type":49,"tag":662,"props":663,"children":664},"tr",{},[665,671,676],{"type":49,"tag":666,"props":667,"children":668},"th",{},[669],{"type":54,"value":670},"Goal",{"type":49,"tag":666,"props":672,"children":673},{},[674],{"type":54,"value":675},"Metric type",{"type":49,"tag":666,"props":677,"children":678},{},[679],{"type":54,"value":680},"Example key",{"type":49,"tag":682,"props":683,"children":684},"tbody",{},[685,708,730,751],{"type":49,"tag":662,"props":686,"children":687},{},[688,694,699],{"type":49,"tag":689,"props":690,"children":691},"td",{},[692],{"type":54,"value":693},"Conversion",{"type":49,"tag":689,"props":695,"children":696},{},[697],{"type":54,"value":698},"Custom conversion",{"type":49,"tag":689,"props":700,"children":701},{},[702],{"type":49,"tag":92,"props":703,"children":705},{"className":704},[],[706],{"type":54,"value":707},"checkout-completed",{"type":49,"tag":662,"props":709,"children":710},{},[711,716,721],{"type":49,"tag":689,"props":712,"children":713},{},[714],{"type":54,"value":715},"Performance",{"type":49,"tag":689,"props":717,"children":718},{},[719],{"type":54,"value":720},"Custom numeric",{"type":49,"tag":689,"props":722,"children":723},{},[724],{"type":49,"tag":92,"props":725,"children":727},{"className":726},[],[728],{"type":54,"value":729},"page-load-time-ms",{"type":49,"tag":662,"props":731,"children":732},{},[733,738,742],{"type":49,"tag":689,"props":734,"children":735},{},[736],{"type":54,"value":737},"Engagement",{"type":49,"tag":689,"props":739,"children":740},{},[741],{"type":54,"value":698},{"type":49,"tag":689,"props":743,"children":744},{},[745],{"type":49,"tag":92,"props":746,"children":748},{"className":747},[],[749],{"type":54,"value":750},"feature-clicked",{"type":49,"tag":662,"props":752,"children":753},{},[754,759,763],{"type":49,"tag":689,"props":755,"children":756},{},[757],{"type":54,"value":758},"Revenue",{"type":49,"tag":689,"props":760,"children":761},{},[762],{"type":54,"value":720},{"type":49,"tag":689,"props":764,"children":765},{},[766],{"type":49,"tag":92,"props":767,"children":769},{"className":768},[],[770],{"type":54,"value":771},"order-value",{"type":49,"tag":265,"props":773,"children":775},{"id":774},"step-2-identify-the-targeting-rule",[776],{"type":54,"value":777},"Step 2: Identify the Targeting Rule",{"type":49,"tag":57,"props":779,"children":780},{},[781,783,788,790,795,797,803,805,811],{"type":54,"value":782},"You need the ",{"type":49,"tag":92,"props":784,"children":786},{"className":785},[],[787],{"type":54,"value":329},{"type":54,"value":789}," and current ",{"type":49,"tag":92,"props":791,"children":793},{"className":792},[],[794],{"type":54,"value":337},{"type":54,"value":796}," of the flag rule that will drive the experiment. Use ",{"type":49,"tag":92,"props":798,"children":800},{"className":799},[],[801],{"type":54,"value":802},"get-flag",{"type":54,"value":804}," on the flag (or its environment-scoped status) to find them. The fallthrough rule's id is the string ",{"type":49,"tag":92,"props":806,"children":808},{"className":807},[],[809],{"type":54,"value":810},"\"fallthrough\"",{"type":54,"value":194},{"type":49,"tag":265,"props":813,"children":815},{"id":814},"step-3-create-the-experiment",[816],{"type":54,"value":817},"Step 3: Create the Experiment",{"type":49,"tag":57,"props":819,"children":820},{},[821,823,828,830,836],{"type":54,"value":822},"Call ",{"type":49,"tag":92,"props":824,"children":826},{"className":825},[],[827],{"type":54,"value":97},{"type":54,"value":829},". The top-level fields describe the experiment; the nested ",{"type":49,"tag":92,"props":831,"children":833},{"className":832},[],[834],{"type":54,"value":835},"iteration",{"type":54,"value":837}," object describes the first data-collection window.",{"type":49,"tag":839,"props":840,"children":845},"pre",{"className":841,"code":842,"language":843,"meta":844,"style":844},"language-json shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"key\": \"checkout-flow-v2-experiment\",\n  \"name\": \"Checkout Flow v2 Experiment\",\n  \"description\": \"Compare the redesigned checkout against the current flow.\",\n  \"tags\": [\"growth\", \"checkout\"],\n  \"methodology\": \"bayesian\",\n  \"iteration\": {\n    \"hypothesis\": \"The redesigned checkout will lift completion rate by 3%.\",\n    \"primarySingleMetricKey\": \"checkout-completed\",\n    \"metrics\": [\n      { \"key\": \"checkout-completed\" },\n      { \"key\": \"checkout-time-seconds\" }\n    ],\n    \"treatments\": [\n      {\n        \"name\": \"Control\",\n        \"baseline\": true,\n        \"allocationPercent\": 50,\n        \"parameters\": [\n          { \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-a-id\" }\n        ]\n      },\n      {\n        \"name\": \"New Checkout\",\n        \"baseline\": false,\n        \"allocationPercent\": 50,\n        \"parameters\": [\n          { \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-b-id\" }\n        ]\n      }\n    ],\n    \"flags\": {\n      \"checkout-flow-v2\": {\n        \"ruleId\": \"fallthrough\",\n        \"flagConfigVersion\": 7\n      }\n    },\n    \"randomizationUnit\": \"user\"\n  }\n}\n","json","",[846],{"type":49,"tag":92,"props":847,"children":848},{"__ignoreMap":844},[849,861,906,944,982,1020,1057,1119,1156,1181,1220,1256,1281,1324,1366,1375,1399,1408,1446,1472,1500,1525,1602,1611,1620,1628,1665,1690,1718,1742,1815,1823,1832,1840,1865,1890,1927,1952,1960,1969,2004,2013],{"type":49,"tag":850,"props":851,"children":854},"span",{"class":852,"line":853},"line",1,[855],{"type":49,"tag":850,"props":856,"children":858},{"style":857},"--shiki-light:#39ADB5;--shiki-default:#89DDFF;--shiki-dark:#89DDFF",[859],{"type":54,"value":860},"{\n",{"type":49,"tag":850,"props":862,"children":864},{"class":852,"line":863},2,[865,870,876,881,886,891,897,901],{"type":49,"tag":850,"props":866,"children":867},{"style":857},[868],{"type":54,"value":869},"  \"",{"type":49,"tag":850,"props":871,"children":873},{"style":872},"--shiki-light:#9C3EDA;--shiki-default:#C792EA;--shiki-dark:#C792EA",[874],{"type":54,"value":875},"projectKey",{"type":49,"tag":850,"props":877,"children":878},{"style":857},[879],{"type":54,"value":880},"\"",{"type":49,"tag":850,"props":882,"children":883},{"style":857},[884],{"type":54,"value":885},":",{"type":49,"tag":850,"props":887,"children":888},{"style":857},[889],{"type":54,"value":890}," \"",{"type":49,"tag":850,"props":892,"children":894},{"style":893},"--shiki-light:#91B859;--shiki-default:#C3E88D;--shiki-dark:#C3E88D",[895],{"type":54,"value":896},"my-project",{"type":49,"tag":850,"props":898,"children":899},{"style":857},[900],{"type":54,"value":880},{"type":49,"tag":850,"props":902,"children":903},{"style":857},[904],{"type":54,"value":905},",\n",{"type":49,"tag":850,"props":907,"children":909},{"class":852,"line":908},3,[910,914,919,923,927,931,936,940],{"type":49,"tag":850,"props":911,"children":912},{"style":857},[913],{"type":54,"value":869},{"type":49,"tag":850,"props":915,"children":916},{"style":872},[917],{"type":54,"value":918},"environmentKey",{"type":49,"tag":850,"props":920,"children":921},{"style":857},[922],{"type":54,"value":880},{"type":49,"tag":850,"props":924,"children":925},{"style":857},[926],{"type":54,"value":885},{"type":49,"tag":850,"props":928,"children":929},{"style":857},[930],{"type":54,"value":890},{"type":49,"tag":850,"props":932,"children":933},{"style":893},[934],{"type":54,"value":935},"production",{"type":49,"tag":850,"props":937,"children":938},{"style":857},[939],{"type":54,"value":880},{"type":49,"tag":850,"props":941,"children":942},{"style":857},[943],{"type":54,"value":905},{"type":49,"tag":850,"props":945,"children":947},{"class":852,"line":946},4,[948,952,957,961,965,969,974,978],{"type":49,"tag":850,"props":949,"children":950},{"style":857},[951],{"type":54,"value":869},{"type":49,"tag":850,"props":953,"children":954},{"style":872},[955],{"type":54,"value":956},"key",{"type":49,"tag":850,"props":958,"children":959},{"style":857},[960],{"type":54,"value":880},{"type":49,"tag":850,"props":962,"children":963},{"style":857},[964],{"type":54,"value":885},{"type":49,"tag":850,"props":966,"children":967},{"style":857},[968],{"type":54,"value":890},{"type":49,"tag":850,"props":970,"children":971},{"style":893},[972],{"type":54,"value":973},"checkout-flow-v2-experiment",{"type":49,"tag":850,"props":975,"children":976},{"style":857},[977],{"type":54,"value":880},{"type":49,"tag":850,"props":979,"children":980},{"style":857},[981],{"type":54,"value":905},{"type":49,"tag":850,"props":983,"children":985},{"class":852,"line":984},5,[986,990,995,999,1003,1007,1012,1016],{"type":49,"tag":850,"props":987,"children":988},{"style":857},[989],{"type":54,"value":869},{"type":49,"tag":850,"props":991,"children":992},{"style":872},[993],{"type":54,"value":994},"name",{"type":49,"tag":850,"props":996,"children":997},{"style":857},[998],{"type":54,"value":880},{"type":49,"tag":850,"props":1000,"children":1001},{"style":857},[1002],{"type":54,"value":885},{"type":49,"tag":850,"props":1004,"children":1005},{"style":857},[1006],{"type":54,"value":890},{"type":49,"tag":850,"props":1008,"children":1009},{"style":893},[1010],{"type":54,"value":1011},"Checkout Flow v2 Experiment",{"type":49,"tag":850,"props":1013,"children":1014},{"style":857},[1015],{"type":54,"value":880},{"type":49,"tag":850,"props":1017,"children":1018},{"style":857},[1019],{"type":54,"value":905},{"type":49,"tag":850,"props":1021,"children":1022},{"class":852,"line":30},[1023,1027,1032,1036,1040,1044,1049,1053],{"type":49,"tag":850,"props":1024,"children":1025},{"style":857},[1026],{"type":54,"value":869},{"type":49,"tag":850,"props":1028,"children":1029},{"style":872},[1030],{"type":54,"value":1031},"description",{"type":49,"tag":850,"props":1033,"children":1034},{"style":857},[1035],{"type":54,"value":880},{"type":49,"tag":850,"props":1037,"children":1038},{"style":857},[1039],{"type":54,"value":885},{"type":49,"tag":850,"props":1041,"children":1042},{"style":857},[1043],{"type":54,"value":890},{"type":49,"tag":850,"props":1045,"children":1046},{"style":893},[1047],{"type":54,"value":1048},"Compare the redesigned checkout against the current flow.",{"type":49,"tag":850,"props":1050,"children":1051},{"style":857},[1052],{"type":54,"value":880},{"type":49,"tag":850,"props":1054,"children":1055},{"style":857},[1056],{"type":54,"value":905},{"type":49,"tag":850,"props":1058,"children":1060},{"class":852,"line":1059},7,[1061,1065,1070,1074,1078,1083,1087,1092,1096,1101,1105,1110,1114],{"type":49,"tag":850,"props":1062,"children":1063},{"style":857},[1064],{"type":54,"value":869},{"type":49,"tag":850,"props":1066,"children":1067},{"style":872},[1068],{"type":54,"value":1069},"tags",{"type":49,"tag":850,"props":1071,"children":1072},{"style":857},[1073],{"type":54,"value":880},{"type":49,"tag":850,"props":1075,"children":1076},{"style":857},[1077],{"type":54,"value":885},{"type":49,"tag":850,"props":1079,"children":1080},{"style":857},[1081],{"type":54,"value":1082}," [",{"type":49,"tag":850,"props":1084,"children":1085},{"style":857},[1086],{"type":54,"value":880},{"type":49,"tag":850,"props":1088,"children":1089},{"style":893},[1090],{"type":54,"value":1091},"growth",{"type":49,"tag":850,"props":1093,"children":1094},{"style":857},[1095],{"type":54,"value":880},{"type":49,"tag":850,"props":1097,"children":1098},{"style":857},[1099],{"type":54,"value":1100},",",{"type":49,"tag":850,"props":1102,"children":1103},{"style":857},[1104],{"type":54,"value":890},{"type":49,"tag":850,"props":1106,"children":1107},{"style":893},[1108],{"type":54,"value":1109},"checkout",{"type":49,"tag":850,"props":1111,"children":1112},{"style":857},[1113],{"type":54,"value":880},{"type":49,"tag":850,"props":1115,"children":1116},{"style":857},[1117],{"type":54,"value":1118},"],\n",{"type":49,"tag":850,"props":1120,"children":1122},{"class":852,"line":1121},8,[1123,1127,1131,1135,1139,1143,1148,1152],{"type":49,"tag":850,"props":1124,"children":1125},{"style":857},[1126],{"type":54,"value":869},{"type":49,"tag":850,"props":1128,"children":1129},{"style":872},[1130],{"type":54,"value":476},{"type":49,"tag":850,"props":1132,"children":1133},{"style":857},[1134],{"type":54,"value":880},{"type":49,"tag":850,"props":1136,"children":1137},{"style":857},[1138],{"type":54,"value":885},{"type":49,"tag":850,"props":1140,"children":1141},{"style":857},[1142],{"type":54,"value":890},{"type":49,"tag":850,"props":1144,"children":1145},{"style":893},[1146],{"type":54,"value":1147},"bayesian",{"type":49,"tag":850,"props":1149,"children":1150},{"style":857},[1151],{"type":54,"value":880},{"type":49,"tag":850,"props":1153,"children":1154},{"style":857},[1155],{"type":54,"value":905},{"type":49,"tag":850,"props":1157,"children":1159},{"class":852,"line":1158},9,[1160,1164,1168,1172,1176],{"type":49,"tag":850,"props":1161,"children":1162},{"style":857},[1163],{"type":54,"value":869},{"type":49,"tag":850,"props":1165,"children":1166},{"style":872},[1167],{"type":54,"value":835},{"type":49,"tag":850,"props":1169,"children":1170},{"style":857},[1171],{"type":54,"value":880},{"type":49,"tag":850,"props":1173,"children":1174},{"style":857},[1175],{"type":54,"value":885},{"type":49,"tag":850,"props":1177,"children":1178},{"style":857},[1179],{"type":54,"value":1180}," {\n",{"type":49,"tag":850,"props":1182,"children":1184},{"class":852,"line":1183},10,[1185,1190,1195,1199,1203,1207,1212,1216],{"type":49,"tag":850,"props":1186,"children":1187},{"style":857},[1188],{"type":54,"value":1189},"    \"",{"type":49,"tag":850,"props":1191,"children":1193},{"style":1192},"--shiki-light:#E2931D;--shiki-default:#FFCB6B;--shiki-dark:#FFCB6B",[1194],{"type":54,"value":546},{"type":49,"tag":850,"props":1196,"children":1197},{"style":857},[1198],{"type":54,"value":880},{"type":49,"tag":850,"props":1200,"children":1201},{"style":857},[1202],{"type":54,"value":885},{"type":49,"tag":850,"props":1204,"children":1205},{"style":857},[1206],{"type":54,"value":890},{"type":49,"tag":850,"props":1208,"children":1209},{"style":893},[1210],{"type":54,"value":1211},"The redesigned checkout will lift completion rate by 3%.",{"type":49,"tag":850,"props":1213,"children":1214},{"style":857},[1215],{"type":54,"value":880},{"type":49,"tag":850,"props":1217,"children":1218},{"style":857},[1219],{"type":54,"value":905},{"type":49,"tag":850,"props":1221,"children":1223},{"class":852,"line":1222},11,[1224,1228,1232,1236,1240,1244,1248,1252],{"type":49,"tag":850,"props":1225,"children":1226},{"style":857},[1227],{"type":54,"value":1189},{"type":49,"tag":850,"props":1229,"children":1230},{"style":1192},[1231],{"type":54,"value":642},{"type":49,"tag":850,"props":1233,"children":1234},{"style":857},[1235],{"type":54,"value":880},{"type":49,"tag":850,"props":1237,"children":1238},{"style":857},[1239],{"type":54,"value":885},{"type":49,"tag":850,"props":1241,"children":1242},{"style":857},[1243],{"type":54,"value":890},{"type":49,"tag":850,"props":1245,"children":1246},{"style":893},[1247],{"type":54,"value":707},{"type":49,"tag":850,"props":1249,"children":1250},{"style":857},[1251],{"type":54,"value":880},{"type":49,"tag":850,"props":1253,"children":1254},{"style":857},[1255],{"type":54,"value":905},{"type":49,"tag":850,"props":1257,"children":1259},{"class":852,"line":1258},12,[1260,1264,1268,1272,1276],{"type":49,"tag":850,"props":1261,"children":1262},{"style":857},[1263],{"type":54,"value":1189},{"type":49,"tag":850,"props":1265,"children":1266},{"style":1192},[1267],{"type":54,"value":469},{"type":49,"tag":850,"props":1269,"children":1270},{"style":857},[1271],{"type":54,"value":880},{"type":49,"tag":850,"props":1273,"children":1274},{"style":857},[1275],{"type":54,"value":885},{"type":49,"tag":850,"props":1277,"children":1278},{"style":857},[1279],{"type":54,"value":1280}," [\n",{"type":49,"tag":850,"props":1282,"children":1284},{"class":852,"line":1283},13,[1285,1290,1294,1299,1303,1307,1311,1315,1319],{"type":49,"tag":850,"props":1286,"children":1287},{"style":857},[1288],{"type":54,"value":1289},"      {",{"type":49,"tag":850,"props":1291,"children":1292},{"style":857},[1293],{"type":54,"value":890},{"type":49,"tag":850,"props":1295,"children":1297},{"style":1296},"--shiki-light:#F76D47;--shiki-default:#F78C6C;--shiki-dark:#F78C6C",[1298],{"type":54,"value":956},{"type":49,"tag":850,"props":1300,"children":1301},{"style":857},[1302],{"type":54,"value":880},{"type":49,"tag":850,"props":1304,"children":1305},{"style":857},[1306],{"type":54,"value":885},{"type":49,"tag":850,"props":1308,"children":1309},{"style":857},[1310],{"type":54,"value":890},{"type":49,"tag":850,"props":1312,"children":1313},{"style":893},[1314],{"type":54,"value":707},{"type":49,"tag":850,"props":1316,"children":1317},{"style":857},[1318],{"type":54,"value":880},{"type":49,"tag":850,"props":1320,"children":1321},{"style":857},[1322],{"type":54,"value":1323}," },\n",{"type":49,"tag":850,"props":1325,"children":1327},{"class":852,"line":1326},14,[1328,1332,1336,1340,1344,1348,1352,1357,1361],{"type":49,"tag":850,"props":1329,"children":1330},{"style":857},[1331],{"type":54,"value":1289},{"type":49,"tag":850,"props":1333,"children":1334},{"style":857},[1335],{"type":54,"value":890},{"type":49,"tag":850,"props":1337,"children":1338},{"style":1296},[1339],{"type":54,"value":956},{"type":49,"tag":850,"props":1341,"children":1342},{"style":857},[1343],{"type":54,"value":880},{"type":49,"tag":850,"props":1345,"children":1346},{"style":857},[1347],{"type":54,"value":885},{"type":49,"tag":850,"props":1349,"children":1350},{"style":857},[1351],{"type":54,"value":890},{"type":49,"tag":850,"props":1353,"children":1354},{"style":893},[1355],{"type":54,"value":1356},"checkout-time-seconds",{"type":49,"tag":850,"props":1358,"children":1359},{"style":857},[1360],{"type":54,"value":880},{"type":49,"tag":850,"props":1362,"children":1363},{"style":857},[1364],{"type":54,"value":1365}," }\n",{"type":49,"tag":850,"props":1367,"children":1369},{"class":852,"line":1368},15,[1370],{"type":49,"tag":850,"props":1371,"children":1372},{"style":857},[1373],{"type":54,"value":1374},"    ],\n",{"type":49,"tag":850,"props":1376,"children":1378},{"class":852,"line":1377},16,[1379,1383,1387,1391,1395],{"type":49,"tag":850,"props":1380,"children":1381},{"style":857},[1382],{"type":54,"value":1189},{"type":49,"tag":850,"props":1384,"children":1385},{"style":1192},[1386],{"type":54,"value":462},{"type":49,"tag":850,"props":1388,"children":1389},{"style":857},[1390],{"type":54,"value":880},{"type":49,"tag":850,"props":1392,"children":1393},{"style":857},[1394],{"type":54,"value":885},{"type":49,"tag":850,"props":1396,"children":1397},{"style":857},[1398],{"type":54,"value":1280},{"type":49,"tag":850,"props":1400,"children":1402},{"class":852,"line":1401},17,[1403],{"type":49,"tag":850,"props":1404,"children":1405},{"style":857},[1406],{"type":54,"value":1407},"      {\n",{"type":49,"tag":850,"props":1409,"children":1411},{"class":852,"line":1410},18,[1412,1417,1421,1425,1429,1433,1438,1442],{"type":49,"tag":850,"props":1413,"children":1414},{"style":857},[1415],{"type":54,"value":1416},"        \"",{"type":49,"tag":850,"props":1418,"children":1419},{"style":1296},[1420],{"type":54,"value":994},{"type":49,"tag":850,"props":1422,"children":1423},{"style":857},[1424],{"type":54,"value":880},{"type":49,"tag":850,"props":1426,"children":1427},{"style":857},[1428],{"type":54,"value":885},{"type":49,"tag":850,"props":1430,"children":1431},{"style":857},[1432],{"type":54,"value":890},{"type":49,"tag":850,"props":1434,"children":1435},{"style":893},[1436],{"type":54,"value":1437},"Control",{"type":49,"tag":850,"props":1439,"children":1440},{"style":857},[1441],{"type":54,"value":880},{"type":49,"tag":850,"props":1443,"children":1444},{"style":857},[1445],{"type":54,"value":905},{"type":49,"tag":850,"props":1447,"children":1449},{"class":852,"line":1448},19,[1450,1454,1459,1463,1467],{"type":49,"tag":850,"props":1451,"children":1452},{"style":857},[1453],{"type":54,"value":1416},{"type":49,"tag":850,"props":1455,"children":1456},{"style":1296},[1457],{"type":54,"value":1458},"baseline",{"type":49,"tag":850,"props":1460,"children":1461},{"style":857},[1462],{"type":54,"value":880},{"type":49,"tag":850,"props":1464,"children":1465},{"style":857},[1466],{"type":54,"value":885},{"type":49,"tag":850,"props":1468,"children":1469},{"style":857},[1470],{"type":54,"value":1471}," true,\n",{"type":49,"tag":850,"props":1473,"children":1474},{"class":852,"line":26},[1475,1479,1483,1487,1491,1496],{"type":49,"tag":850,"props":1476,"children":1477},{"style":857},[1478],{"type":54,"value":1416},{"type":49,"tag":850,"props":1480,"children":1481},{"style":1296},[1482],{"type":54,"value":294},{"type":49,"tag":850,"props":1484,"children":1485},{"style":857},[1486],{"type":54,"value":880},{"type":49,"tag":850,"props":1488,"children":1489},{"style":857},[1490],{"type":54,"value":885},{"type":49,"tag":850,"props":1492,"children":1493},{"style":1296},[1494],{"type":54,"value":1495}," 50",{"type":49,"tag":850,"props":1497,"children":1498},{"style":857},[1499],{"type":54,"value":905},{"type":49,"tag":850,"props":1501,"children":1503},{"class":852,"line":1502},21,[1504,1508,1513,1517,1521],{"type":49,"tag":850,"props":1505,"children":1506},{"style":857},[1507],{"type":54,"value":1416},{"type":49,"tag":850,"props":1509,"children":1510},{"style":1296},[1511],{"type":54,"value":1512},"parameters",{"type":49,"tag":850,"props":1514,"children":1515},{"style":857},[1516],{"type":54,"value":880},{"type":49,"tag":850,"props":1518,"children":1519},{"style":857},[1520],{"type":54,"value":885},{"type":49,"tag":850,"props":1522,"children":1523},{"style":857},[1524],{"type":54,"value":1280},{"type":49,"tag":850,"props":1526,"children":1528},{"class":852,"line":1527},22,[1529,1534,1538,1543,1547,1551,1555,1560,1564,1568,1572,1577,1581,1585,1589,1594,1598],{"type":49,"tag":850,"props":1530,"children":1531},{"style":857},[1532],{"type":54,"value":1533},"          {",{"type":49,"tag":850,"props":1535,"children":1536},{"style":857},[1537],{"type":54,"value":890},{"type":49,"tag":850,"props":1539,"children":1541},{"style":1540},"--shiki-light:#E53935;--shiki-default:#F07178;--shiki-dark:#F07178",[1542],{"type":54,"value":322},{"type":49,"tag":850,"props":1544,"children":1545},{"style":857},[1546],{"type":54,"value":880},{"type":49,"tag":850,"props":1548,"children":1549},{"style":857},[1550],{"type":54,"value":885},{"type":49,"tag":850,"props":1552,"children":1553},{"style":857},[1554],{"type":54,"value":890},{"type":49,"tag":850,"props":1556,"children":1557},{"style":893},[1558],{"type":54,"value":1559},"checkout-flow-v2",{"type":49,"tag":850,"props":1561,"children":1562},{"style":857},[1563],{"type":54,"value":880},{"type":49,"tag":850,"props":1565,"children":1566},{"style":857},[1567],{"type":54,"value":1100},{"type":49,"tag":850,"props":1569,"children":1570},{"style":857},[1571],{"type":54,"value":890},{"type":49,"tag":850,"props":1573,"children":1574},{"style":1540},[1575],{"type":54,"value":1576},"variationId",{"type":49,"tag":850,"props":1578,"children":1579},{"style":857},[1580],{"type":54,"value":880},{"type":49,"tag":850,"props":1582,"children":1583},{"style":857},[1584],{"type":54,"value":885},{"type":49,"tag":850,"props":1586,"children":1587},{"style":857},[1588],{"type":54,"value":890},{"type":49,"tag":850,"props":1590,"children":1591},{"style":893},[1592],{"type":54,"value":1593},"variation-a-id",{"type":49,"tag":850,"props":1595,"children":1596},{"style":857},[1597],{"type":54,"value":880},{"type":49,"tag":850,"props":1599,"children":1600},{"style":857},[1601],{"type":54,"value":1365},{"type":49,"tag":850,"props":1603,"children":1605},{"class":852,"line":1604},23,[1606],{"type":49,"tag":850,"props":1607,"children":1608},{"style":857},[1609],{"type":54,"value":1610},"        ]\n",{"type":49,"tag":850,"props":1612,"children":1614},{"class":852,"line":1613},24,[1615],{"type":49,"tag":850,"props":1616,"children":1617},{"style":857},[1618],{"type":54,"value":1619},"      },\n",{"type":49,"tag":850,"props":1621,"children":1623},{"class":852,"line":1622},25,[1624],{"type":49,"tag":850,"props":1625,"children":1626},{"style":857},[1627],{"type":54,"value":1407},{"type":49,"tag":850,"props":1629,"children":1631},{"class":852,"line":1630},26,[1632,1636,1640,1644,1648,1652,1657,1661],{"type":49,"tag":850,"props":1633,"children":1634},{"style":857},[1635],{"type":54,"value":1416},{"type":49,"tag":850,"props":1637,"children":1638},{"style":1296},[1639],{"type":54,"value":994},{"type":49,"tag":850,"props":1641,"children":1642},{"style":857},[1643],{"type":54,"value":880},{"type":49,"tag":850,"props":1645,"children":1646},{"style":857},[1647],{"type":54,"value":885},{"type":49,"tag":850,"props":1649,"children":1650},{"style":857},[1651],{"type":54,"value":890},{"type":49,"tag":850,"props":1653,"children":1654},{"style":893},[1655],{"type":54,"value":1656},"New Checkout",{"type":49,"tag":850,"props":1658,"children":1659},{"style":857},[1660],{"type":54,"value":880},{"type":49,"tag":850,"props":1662,"children":1663},{"style":857},[1664],{"type":54,"value":905},{"type":49,"tag":850,"props":1666,"children":1668},{"class":852,"line":1667},27,[1669,1673,1677,1681,1685],{"type":49,"tag":850,"props":1670,"children":1671},{"style":857},[1672],{"type":54,"value":1416},{"type":49,"tag":850,"props":1674,"children":1675},{"style":1296},[1676],{"type":54,"value":1458},{"type":49,"tag":850,"props":1678,"children":1679},{"style":857},[1680],{"type":54,"value":880},{"type":49,"tag":850,"props":1682,"children":1683},{"style":857},[1684],{"type":54,"value":885},{"type":49,"tag":850,"props":1686,"children":1687},{"style":857},[1688],{"type":54,"value":1689}," false,\n",{"type":49,"tag":850,"props":1691,"children":1693},{"class":852,"line":1692},28,[1694,1698,1702,1706,1710,1714],{"type":49,"tag":850,"props":1695,"children":1696},{"style":857},[1697],{"type":54,"value":1416},{"type":49,"tag":850,"props":1699,"children":1700},{"style":1296},[1701],{"type":54,"value":294},{"type":49,"tag":850,"props":1703,"children":1704},{"style":857},[1705],{"type":54,"value":880},{"type":49,"tag":850,"props":1707,"children":1708},{"style":857},[1709],{"type":54,"value":885},{"type":49,"tag":850,"props":1711,"children":1712},{"style":1296},[1713],{"type":54,"value":1495},{"type":49,"tag":850,"props":1715,"children":1716},{"style":857},[1717],{"type":54,"value":905},{"type":49,"tag":850,"props":1719,"children":1721},{"class":852,"line":1720},29,[1722,1726,1730,1734,1738],{"type":49,"tag":850,"props":1723,"children":1724},{"style":857},[1725],{"type":54,"value":1416},{"type":49,"tag":850,"props":1727,"children":1728},{"style":1296},[1729],{"type":54,"value":1512},{"type":49,"tag":850,"props":1731,"children":1732},{"style":857},[1733],{"type":54,"value":880},{"type":49,"tag":850,"props":1735,"children":1736},{"style":857},[1737],{"type":54,"value":885},{"type":49,"tag":850,"props":1739,"children":1740},{"style":857},[1741],{"type":54,"value":1280},{"type":49,"tag":850,"props":1743,"children":1745},{"class":852,"line":1744},30,[1746,1750,1754,1758,1762,1766,1770,1774,1778,1782,1786,1790,1794,1798,1802,1807,1811],{"type":49,"tag":850,"props":1747,"children":1748},{"style":857},[1749],{"type":54,"value":1533},{"type":49,"tag":850,"props":1751,"children":1752},{"style":857},[1753],{"type":54,"value":890},{"type":49,"tag":850,"props":1755,"children":1756},{"style":1540},[1757],{"type":54,"value":322},{"type":49,"tag":850,"props":1759,"children":1760},{"style":857},[1761],{"type":54,"value":880},{"type":49,"tag":850,"props":1763,"children":1764},{"style":857},[1765],{"type":54,"value":885},{"type":49,"tag":850,"props":1767,"children":1768},{"style":857},[1769],{"type":54,"value":890},{"type":49,"tag":850,"props":1771,"children":1772},{"style":893},[1773],{"type":54,"value":1559},{"type":49,"tag":850,"props":1775,"children":1776},{"style":857},[1777],{"type":54,"value":880},{"type":49,"tag":850,"props":1779,"children":1780},{"style":857},[1781],{"type":54,"value":1100},{"type":49,"tag":850,"props":1783,"children":1784},{"style":857},[1785],{"type":54,"value":890},{"type":49,"tag":850,"props":1787,"children":1788},{"style":1540},[1789],{"type":54,"value":1576},{"type":49,"tag":850,"props":1791,"children":1792},{"style":857},[1793],{"type":54,"value":880},{"type":49,"tag":850,"props":1795,"children":1796},{"style":857},[1797],{"type":54,"value":885},{"type":49,"tag":850,"props":1799,"children":1800},{"style":857},[1801],{"type":54,"value":890},{"type":49,"tag":850,"props":1803,"children":1804},{"style":893},[1805],{"type":54,"value":1806},"variation-b-id",{"type":49,"tag":850,"props":1808,"children":1809},{"style":857},[1810],{"type":54,"value":880},{"type":49,"tag":850,"props":1812,"children":1813},{"style":857},[1814],{"type":54,"value":1365},{"type":49,"tag":850,"props":1816,"children":1818},{"class":852,"line":1817},31,[1819],{"type":49,"tag":850,"props":1820,"children":1821},{"style":857},[1822],{"type":54,"value":1610},{"type":49,"tag":850,"props":1824,"children":1826},{"class":852,"line":1825},32,[1827],{"type":49,"tag":850,"props":1828,"children":1829},{"style":857},[1830],{"type":54,"value":1831},"      }\n",{"type":49,"tag":850,"props":1833,"children":1835},{"class":852,"line":1834},33,[1836],{"type":49,"tag":850,"props":1837,"children":1838},{"style":857},[1839],{"type":54,"value":1374},{"type":49,"tag":850,"props":1841,"children":1843},{"class":852,"line":1842},34,[1844,1848,1853,1857,1861],{"type":49,"tag":850,"props":1845,"children":1846},{"style":857},[1847],{"type":54,"value":1189},{"type":49,"tag":850,"props":1849,"children":1850},{"style":1192},[1851],{"type":54,"value":1852},"flags",{"type":49,"tag":850,"props":1854,"children":1855},{"style":857},[1856],{"type":54,"value":880},{"type":49,"tag":850,"props":1858,"children":1859},{"style":857},[1860],{"type":54,"value":885},{"type":49,"tag":850,"props":1862,"children":1863},{"style":857},[1864],{"type":54,"value":1180},{"type":49,"tag":850,"props":1866,"children":1868},{"class":852,"line":1867},35,[1869,1874,1878,1882,1886],{"type":49,"tag":850,"props":1870,"children":1871},{"style":857},[1872],{"type":54,"value":1873},"      \"",{"type":49,"tag":850,"props":1875,"children":1876},{"style":1296},[1877],{"type":54,"value":1559},{"type":49,"tag":850,"props":1879,"children":1880},{"style":857},[1881],{"type":54,"value":880},{"type":49,"tag":850,"props":1883,"children":1884},{"style":857},[1885],{"type":54,"value":885},{"type":49,"tag":850,"props":1887,"children":1888},{"style":857},[1889],{"type":54,"value":1180},{"type":49,"tag":850,"props":1891,"children":1893},{"class":852,"line":1892},36,[1894,1898,1902,1906,1910,1914,1919,1923],{"type":49,"tag":850,"props":1895,"children":1896},{"style":857},[1897],{"type":54,"value":1416},{"type":49,"tag":850,"props":1899,"children":1900},{"style":1540},[1901],{"type":54,"value":329},{"type":49,"tag":850,"props":1903,"children":1904},{"style":857},[1905],{"type":54,"value":880},{"type":49,"tag":850,"props":1907,"children":1908},{"style":857},[1909],{"type":54,"value":885},{"type":49,"tag":850,"props":1911,"children":1912},{"style":857},[1913],{"type":54,"value":890},{"type":49,"tag":850,"props":1915,"children":1916},{"style":893},[1917],{"type":54,"value":1918},"fallthrough",{"type":49,"tag":850,"props":1920,"children":1921},{"style":857},[1922],{"type":54,"value":880},{"type":49,"tag":850,"props":1924,"children":1925},{"style":857},[1926],{"type":54,"value":905},{"type":49,"tag":850,"props":1928,"children":1930},{"class":852,"line":1929},37,[1931,1935,1939,1943,1947],{"type":49,"tag":850,"props":1932,"children":1933},{"style":857},[1934],{"type":54,"value":1416},{"type":49,"tag":850,"props":1936,"children":1937},{"style":1540},[1938],{"type":54,"value":337},{"type":49,"tag":850,"props":1940,"children":1941},{"style":857},[1942],{"type":54,"value":880},{"type":49,"tag":850,"props":1944,"children":1945},{"style":857},[1946],{"type":54,"value":885},{"type":49,"tag":850,"props":1948,"children":1949},{"style":1296},[1950],{"type":54,"value":1951}," 7\n",{"type":49,"tag":850,"props":1953,"children":1955},{"class":852,"line":1954},38,[1956],{"type":49,"tag":850,"props":1957,"children":1958},{"style":857},[1959],{"type":54,"value":1831},{"type":49,"tag":850,"props":1961,"children":1963},{"class":852,"line":1962},39,[1964],{"type":49,"tag":850,"props":1965,"children":1966},{"style":857},[1967],{"type":54,"value":1968},"    },\n",{"type":49,"tag":850,"props":1970,"children":1972},{"class":852,"line":1971},40,[1973,1977,1982,1986,1990,1994,1999],{"type":49,"tag":850,"props":1974,"children":1975},{"style":857},[1976],{"type":54,"value":1189},{"type":49,"tag":850,"props":1978,"children":1979},{"style":1192},[1980],{"type":54,"value":1981},"randomizationUnit",{"type":49,"tag":850,"props":1983,"children":1984},{"style":857},[1985],{"type":54,"value":880},{"type":49,"tag":850,"props":1987,"children":1988},{"style":857},[1989],{"type":54,"value":885},{"type":49,"tag":850,"props":1991,"children":1992},{"style":857},[1993],{"type":54,"value":890},{"type":49,"tag":850,"props":1995,"children":1996},{"style":893},[1997],{"type":54,"value":1998},"user",{"type":49,"tag":850,"props":2000,"children":2001},{"style":857},[2002],{"type":54,"value":2003},"\"\n",{"type":49,"tag":850,"props":2005,"children":2007},{"class":852,"line":2006},41,[2008],{"type":49,"tag":850,"props":2009,"children":2010},{"style":857},[2011],{"type":54,"value":2012},"  }\n",{"type":49,"tag":850,"props":2014,"children":2016},{"class":852,"line":2015},42,[2017],{"type":49,"tag":850,"props":2018,"children":2019},{"style":857},[2020],{"type":54,"value":2021},"}\n",{"type":49,"tag":57,"props":2023,"children":2024},{},[2025],{"type":54,"value":2026},"Useful optional top-level fields:",{"type":49,"tag":84,"props":2028,"children":2029},{},[2030,2040,2073,2103],{"type":49,"tag":88,"props":2031,"children":2032},{},[2033,2038],{"type":49,"tag":92,"props":2034,"children":2036},{"className":2035},[],[2037],{"type":54,"value":386},{"type":54,"value":2039}," — attach an existing holdout.",{"type":49,"tag":88,"props":2041,"children":2042},{},[2043,2049,2051,2057,2059,2065,2066,2072],{"type":49,"tag":92,"props":2044,"children":2046},{"className":2045},[],[2047],{"type":54,"value":2048},"dataSource",{"type":54,"value":2050}," — ",{"type":49,"tag":92,"props":2052,"children":2054},{"className":2053},[],[2055],{"type":54,"value":2056},"\"launchdarkly\"",{"type":54,"value":2058}," (default), ",{"type":49,"tag":92,"props":2060,"children":2062},{"className":2061},[],[2063],{"type":54,"value":2064},"\"snowflake\"",{"type":54,"value":178},{"type":49,"tag":92,"props":2067,"children":2069},{"className":2068},[],[2070],{"type":54,"value":2071},"\"databricks\"",{"type":54,"value":194},{"type":49,"tag":88,"props":2074,"children":2075},{},[2076,2081,2082,2088,2089,2095,2096,2102],{"type":49,"tag":92,"props":2077,"children":2079},{"className":2078},[],[2080],{"type":54,"value":476},{"type":54,"value":2050},{"type":49,"tag":92,"props":2083,"children":2085},{"className":2084},[],[2086],{"type":54,"value":2087},"\"bayesian\"",{"type":54,"value":2058},{"type":49,"tag":92,"props":2090,"children":2092},{"className":2091},[],[2093],{"type":54,"value":2094},"\"frequentist\"",{"type":54,"value":178},{"type":49,"tag":92,"props":2097,"children":2099},{"className":2098},[],[2100],{"type":54,"value":2101},"\"export_only\"",{"type":54,"value":194},{"type":49,"tag":88,"props":2104,"children":2105},{},[2106,2112],{"type":49,"tag":92,"props":2107,"children":2109},{"className":2108},[],[2110],{"type":54,"value":2111},"analysisConfig",{"type":54,"value":2113}," — set thresholds, multiple-comparison correction, or sequential testing.",{"type":49,"tag":57,"props":2115,"children":2116},{},[2117],{"type":54,"value":2118},"Useful optional iteration fields:",{"type":49,"tag":84,"props":2120,"children":2121},{},[2122,2140,2151],{"type":49,"tag":88,"props":2123,"children":2124},{},[2125,2131,2133,2139],{"type":49,"tag":92,"props":2126,"children":2128},{"className":2127},[],[2129],{"type":54,"value":2130},"attributes",{"type":54,"value":2132}," — array of context attribute keys to slice results by (e.g. ",{"type":49,"tag":92,"props":2134,"children":2136},{"className":2135},[],[2137],{"type":54,"value":2138},"[\"country\", \"device\"]",{"type":54,"value":388},{"type":49,"tag":88,"props":2141,"children":2142},{},[2143,2149],{"type":49,"tag":92,"props":2144,"children":2146},{"className":2145},[],[2147],{"type":54,"value":2148},"covariateId",{"type":54,"value":2150}," — covariate CSV id for stratified sampling.",{"type":49,"tag":88,"props":2152,"children":2153},{},[2154,2160,2162,2168,2170,2176],{"type":49,"tag":92,"props":2155,"children":2157},{"className":2156},[],[2158],{"type":54,"value":2159},"canReshuffleTraffic",{"type":54,"value":2161}," — defaults to ",{"type":49,"tag":92,"props":2163,"children":2165},{"className":2164},[],[2166],{"type":54,"value":2167},"true",{"type":54,"value":2169},"; set ",{"type":49,"tag":92,"props":2171,"children":2173},{"className":2172},[],[2174],{"type":54,"value":2175},"false",{"type":54,"value":2177}," to lock users to their initial variation when allocations change.",{"type":49,"tag":265,"props":2179,"children":2181},{"id":2180},"step-4-start-data-collection",[2182],{"type":54,"value":2183},"Step 4: Start Data Collection",{"type":49,"tag":839,"props":2185,"children":2187},{"className":841,"code":2186,"language":843,"meta":844,"style":844},"{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"experimentKey\": \"checkout-flow-v2-experiment\"\n}\n",[2188],{"type":49,"tag":92,"props":2189,"children":2190},{"__ignoreMap":844},[2191,2198,2233,2268,2300],{"type":49,"tag":850,"props":2192,"children":2193},{"class":852,"line":853},[2194],{"type":49,"tag":850,"props":2195,"children":2196},{"style":857},[2197],{"type":54,"value":860},{"type":49,"tag":850,"props":2199,"children":2200},{"class":852,"line":863},[2201,2205,2209,2213,2217,2221,2225,2229],{"type":49,"tag":850,"props":2202,"children":2203},{"style":857},[2204],{"type":54,"value":869},{"type":49,"tag":850,"props":2206,"children":2207},{"style":872},[2208],{"type":54,"value":875},{"type":49,"tag":850,"props":2210,"children":2211},{"style":857},[2212],{"type":54,"value":880},{"type":49,"tag":850,"props":2214,"children":2215},{"style":857},[2216],{"type":54,"value":885},{"type":49,"tag":850,"props":2218,"children":2219},{"style":857},[2220],{"type":54,"value":890},{"type":49,"tag":850,"props":2222,"children":2223},{"style":893},[2224],{"type":54,"value":896},{"type":49,"tag":850,"props":2226,"children":2227},{"style":857},[2228],{"type":54,"value":880},{"type":49,"tag":850,"props":2230,"children":2231},{"style":857},[2232],{"type":54,"value":905},{"type":49,"tag":850,"props":2234,"children":2235},{"class":852,"line":908},[2236,2240,2244,2248,2252,2256,2260,2264],{"type":49,"tag":850,"props":2237,"children":2238},{"style":857},[2239],{"type":54,"value":869},{"type":49,"tag":850,"props":2241,"children":2242},{"style":872},[2243],{"type":54,"value":918},{"type":49,"tag":850,"props":2245,"children":2246},{"style":857},[2247],{"type":54,"value":880},{"type":49,"tag":850,"props":2249,"children":2250},{"style":857},[2251],{"type":54,"value":885},{"type":49,"tag":850,"props":2253,"children":2254},{"style":857},[2255],{"type":54,"value":890},{"type":49,"tag":850,"props":2257,"children":2258},{"style":893},[2259],{"type":54,"value":935},{"type":49,"tag":850,"props":2261,"children":2262},{"style":857},[2263],{"type":54,"value":880},{"type":49,"tag":850,"props":2265,"children":2266},{"style":857},[2267],{"type":54,"value":905},{"type":49,"tag":850,"props":2269,"children":2270},{"class":852,"line":946},[2271,2275,2280,2284,2288,2292,2296],{"type":49,"tag":850,"props":2272,"children":2273},{"style":857},[2274],{"type":54,"value":869},{"type":49,"tag":850,"props":2276,"children":2277},{"style":872},[2278],{"type":54,"value":2279},"experimentKey",{"type":49,"tag":850,"props":2281,"children":2282},{"style":857},[2283],{"type":54,"value":880},{"type":49,"tag":850,"props":2285,"children":2286},{"style":857},[2287],{"type":54,"value":885},{"type":49,"tag":850,"props":2289,"children":2290},{"style":857},[2291],{"type":54,"value":890},{"type":49,"tag":850,"props":2293,"children":2294},{"style":893},[2295],{"type":54,"value":973},{"type":49,"tag":850,"props":2297,"children":2298},{"style":857},[2299],{"type":54,"value":2003},{"type":49,"tag":850,"props":2301,"children":2302},{"class":852,"line":984},[2303],{"type":49,"tag":850,"props":2304,"children":2305},{"style":857},[2306],{"type":54,"value":2021},{"type":49,"tag":57,"props":2308,"children":2309},{},[2310],{"type":54,"value":2311},"Before starting, the API requires that:",{"type":49,"tag":84,"props":2313,"children":2314},{},[2315,2320,2332],{"type":49,"tag":88,"props":2316,"children":2317},{},[2318],{"type":54,"value":2319},"the flag is toggled on,",{"type":49,"tag":88,"props":2321,"children":2322},{},[2323,2325,2330],{"type":54,"value":2324},"the iteration has a ",{"type":49,"tag":92,"props":2326,"children":2328},{"className":2327},[],[2329],{"type":54,"value":1981},{"type":54,"value":2331},", and",{"type":49,"tag":88,"props":2333,"children":2334},{},[2335,2337,2342],{"type":54,"value":2336},"at least one treatment has a non-zero ",{"type":49,"tag":92,"props":2338,"children":2340},{"className":2339},[],[2341],{"type":54,"value":294},{"type":54,"value":194},{"type":49,"tag":57,"props":2344,"children":2345},{},[2346,2348,2354],{"type":54,"value":2347},"Pass ",{"type":49,"tag":92,"props":2349,"children":2351},{"className":2350},[],[2352],{"type":54,"value":2353},"changeJustification",{"type":54,"value":2355}," if you're restarting after a prior iteration was stopped.",{"type":49,"tag":265,"props":2357,"children":2359},{"id":2358},"step-5-verify",[2360],{"type":54,"value":2361},"Step 5: Verify",{"type":49,"tag":396,"props":2363,"children":2364},{},[2365,2383,2388],{"type":49,"tag":88,"props":2366,"children":2367},{},[2368,2369,2374,2376,2382],{"type":54,"value":822},{"type":49,"tag":92,"props":2370,"children":2372},{"className":2371},[],[2373],{"type":54,"value":119},{"type":54,"value":2375}," and confirm ",{"type":49,"tag":92,"props":2377,"children":2379},{"className":2378},[],[2380],{"type":54,"value":2381},"currentIteration.status === \"running\"",{"type":54,"value":194},{"type":49,"tag":88,"props":2384,"children":2385},{},[2386],{"type":54,"value":2387},"Check that treatments are present with the expected allocations.",{"type":49,"tag":88,"props":2389,"children":2390},{},[2391],{"type":54,"value":2392},"Check the metric list and the primary metric.",{"type":49,"tag":265,"props":2394,"children":2396},{"id":2395},"step-6-evolve-the-design-mid-experiment-when-needed",[2397],{"type":54,"value":2398},"Step 6: Evolve the Design Mid-Experiment (when needed)",{"type":49,"tag":57,"props":2400,"children":2401},{},[2402,2404,2409],{"type":54,"value":2403},"Most structural fields (treatments, metrics, methodology, hypothesis, …) are locked while an iteration is ",{"type":49,"tag":92,"props":2405,"children":2407},{"className":2406},[],[2408],{"type":54,"value":176},{"type":54,"value":2410},". Two ways to change them:",{"type":49,"tag":84,"props":2412,"children":2413},{},[2414,2491],{"type":49,"tag":88,"props":2415,"children":2416},{},[2417,2422,2423,2428,2430,2435,2437,2442,2444,2449,2450,2455,2456,2462,2463,2468,2470,2475,2477,2482,2484,2489],{"type":49,"tag":78,"props":2418,"children":2419},{},[2420],{"type":54,"value":2421},"Light edits while running",{"type":54,"value":2050},{"type":49,"tag":92,"props":2424,"children":2426},{"className":2425},[],[2427],{"type":54,"value":152},{"type":54,"value":2429}," will let through anything ",{"type":49,"tag":92,"props":2431,"children":2433},{"className":2432},[],[2434],{"type":54,"value":160},{"type":54,"value":2436}," permits in the ",{"type":49,"tag":92,"props":2438,"children":2440},{"className":2439},[],[2441],{"type":54,"value":176},{"type":54,"value":2443}," state (typically just metadata like ",{"type":49,"tag":92,"props":2445,"children":2447},{"className":2446},[],[2448],{"type":54,"value":994},{"type":54,"value":170},{"type":49,"tag":92,"props":2451,"children":2453},{"className":2452},[],[2454],{"type":54,"value":1031},{"type":54,"value":170},{"type":49,"tag":92,"props":2457,"children":2459},{"className":2458},[],[2460],{"type":54,"value":2461},"maintainerId",{"type":54,"value":170},{"type":49,"tag":92,"props":2464,"children":2466},{"className":2465},[],[2467],{"type":54,"value":1069},{"type":54,"value":2469},", plus appending ",{"type":49,"tag":92,"props":2471,"children":2473},{"className":2472},[],[2474],{"type":54,"value":469},{"type":54,"value":2476},"\u002F",{"type":49,"tag":92,"props":2478,"children":2480},{"className":2479},[],[2481],{"type":54,"value":2130},{"type":54,"value":2483},"). It surfaces rejected fields under ",{"type":49,"tag":92,"props":2485,"children":2487},{"className":2486},[],[2488],{"type":54,"value":192},{"type":54,"value":2490}," with a reason.",{"type":49,"tag":88,"props":2492,"children":2493},{},[2494,2499,2501,2506,2508,2513,2515,2520,2522,2527],{"type":49,"tag":78,"props":2495,"children":2496},{},[2497],{"type":54,"value":2498},"Real design changes",{"type":54,"value":2500}," — call ",{"type":49,"tag":92,"props":2502,"children":2504},{"className":2503},[],[2505],{"type":54,"value":203},{"type":54,"value":2507},". It stops the current iteration, creates a new draft with the supplied field updates applied, and starts it in one call. Inputs match ",{"type":49,"tag":92,"props":2509,"children":2511},{"className":2510},[],[2512],{"type":54,"value":152},{"type":54,"value":2514},", plus ",{"type":49,"tag":92,"props":2516,"children":2518},{"className":2517},[],[2519],{"type":54,"value":2353},{"type":54,"value":2521},". Mutability is checked against ",{"type":49,"tag":92,"props":2523,"children":2525},{"className":2524},[],[2526],{"type":54,"value":168},{"type":54,"value":2528}," since updates land on the new draft.",{"type":49,"tag":57,"props":2530,"children":2531},{},[2532],{"type":54,"value":2533},"Example: swap the treatment allocation and add a metric in a single call.",{"type":49,"tag":839,"props":2535,"children":2537},{"className":841,"code":2536,"language":843,"meta":844,"style":844},"{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"experimentKey\": \"checkout-flow-v2-experiment\",\n  \"changeJustification\": \"Lowering control allocation now that variant looks safe.\",\n  \"treatments\": [\n    {\n      \"name\": \"Control\",\n      \"baseline\": true,\n      \"allocationPercent\": 30,\n      \"parameters\": [{ \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-a-id\" }]\n    },\n    {\n      \"name\": \"New Checkout\",\n      \"baseline\": false,\n      \"allocationPercent\": 70,\n      \"parameters\": [{ \"flagKey\": \"checkout-flow-v2\", \"variationId\": \"variation-b-id\" }]\n    }\n  ],\n  \"metrics\": [\n    { \"key\": \"checkout-completed\" },\n    { \"key\": \"checkout-time-seconds\" },\n    { \"key\": \"checkout-error-rate\" }\n  ]\n}\n",[2538],{"type":49,"tag":92,"props":2539,"children":2540},{"__ignoreMap":844},[2541,2548,2583,2618,2653,2689,2712,2720,2755,2778,2806,2895,2902,2909,2944,2967,2995,3082,3090,3098,3121,3161,3200,3240,3248],{"type":49,"tag":850,"props":2542,"children":2543},{"class":852,"line":853},[2544],{"type":49,"tag":850,"props":2545,"children":2546},{"style":857},[2547],{"type":54,"value":860},{"type":49,"tag":850,"props":2549,"children":2550},{"class":852,"line":863},[2551,2555,2559,2563,2567,2571,2575,2579],{"type":49,"tag":850,"props":2552,"children":2553},{"style":857},[2554],{"type":54,"value":869},{"type":49,"tag":850,"props":2556,"children":2557},{"style":872},[2558],{"type":54,"value":875},{"type":49,"tag":850,"props":2560,"children":2561},{"style":857},[2562],{"type":54,"value":880},{"type":49,"tag":850,"props":2564,"children":2565},{"style":857},[2566],{"type":54,"value":885},{"type":49,"tag":850,"props":2568,"children":2569},{"style":857},[2570],{"type":54,"value":890},{"type":49,"tag":850,"props":2572,"children":2573},{"style":893},[2574],{"type":54,"value":896},{"type":49,"tag":850,"props":2576,"children":2577},{"style":857},[2578],{"type":54,"value":880},{"type":49,"tag":850,"props":2580,"children":2581},{"style":857},[2582],{"type":54,"value":905},{"type":49,"tag":850,"props":2584,"children":2585},{"class":852,"line":908},[2586,2590,2594,2598,2602,2606,2610,2614],{"type":49,"tag":850,"props":2587,"children":2588},{"style":857},[2589],{"type":54,"value":869},{"type":49,"tag":850,"props":2591,"children":2592},{"style":872},[2593],{"type":54,"value":918},{"type":49,"tag":850,"props":2595,"children":2596},{"style":857},[2597],{"type":54,"value":880},{"type":49,"tag":850,"props":2599,"children":2600},{"style":857},[2601],{"type":54,"value":885},{"type":49,"tag":850,"props":2603,"children":2604},{"style":857},[2605],{"type":54,"value":890},{"type":49,"tag":850,"props":2607,"children":2608},{"style":893},[2609],{"type":54,"value":935},{"type":49,"tag":850,"props":2611,"children":2612},{"style":857},[2613],{"type":54,"value":880},{"type":49,"tag":850,"props":2615,"children":2616},{"style":857},[2617],{"type":54,"value":905},{"type":49,"tag":850,"props":2619,"children":2620},{"class":852,"line":946},[2621,2625,2629,2633,2637,2641,2645,2649],{"type":49,"tag":850,"props":2622,"children":2623},{"style":857},[2624],{"type":54,"value":869},{"type":49,"tag":850,"props":2626,"children":2627},{"style":872},[2628],{"type":54,"value":2279},{"type":49,"tag":850,"props":2630,"children":2631},{"style":857},[2632],{"type":54,"value":880},{"type":49,"tag":850,"props":2634,"children":2635},{"style":857},[2636],{"type":54,"value":885},{"type":49,"tag":850,"props":2638,"children":2639},{"style":857},[2640],{"type":54,"value":890},{"type":49,"tag":850,"props":2642,"children":2643},{"style":893},[2644],{"type":54,"value":973},{"type":49,"tag":850,"props":2646,"children":2647},{"style":857},[2648],{"type":54,"value":880},{"type":49,"tag":850,"props":2650,"children":2651},{"style":857},[2652],{"type":54,"value":905},{"type":49,"tag":850,"props":2654,"children":2655},{"class":852,"line":984},[2656,2660,2664,2668,2672,2676,2681,2685],{"type":49,"tag":850,"props":2657,"children":2658},{"style":857},[2659],{"type":54,"value":869},{"type":49,"tag":850,"props":2661,"children":2662},{"style":872},[2663],{"type":54,"value":2353},{"type":49,"tag":850,"props":2665,"children":2666},{"style":857},[2667],{"type":54,"value":880},{"type":49,"tag":850,"props":2669,"children":2670},{"style":857},[2671],{"type":54,"value":885},{"type":49,"tag":850,"props":2673,"children":2674},{"style":857},[2675],{"type":54,"value":890},{"type":49,"tag":850,"props":2677,"children":2678},{"style":893},[2679],{"type":54,"value":2680},"Lowering control allocation now that variant looks safe.",{"type":49,"tag":850,"props":2682,"children":2683},{"style":857},[2684],{"type":54,"value":880},{"type":49,"tag":850,"props":2686,"children":2687},{"style":857},[2688],{"type":54,"value":905},{"type":49,"tag":850,"props":2690,"children":2691},{"class":852,"line":30},[2692,2696,2700,2704,2708],{"type":49,"tag":850,"props":2693,"children":2694},{"style":857},[2695],{"type":54,"value":869},{"type":49,"tag":850,"props":2697,"children":2698},{"style":872},[2699],{"type":54,"value":462},{"type":49,"tag":850,"props":2701,"children":2702},{"style":857},[2703],{"type":54,"value":880},{"type":49,"tag":850,"props":2705,"children":2706},{"style":857},[2707],{"type":54,"value":885},{"type":49,"tag":850,"props":2709,"children":2710},{"style":857},[2711],{"type":54,"value":1280},{"type":49,"tag":850,"props":2713,"children":2714},{"class":852,"line":1059},[2715],{"type":49,"tag":850,"props":2716,"children":2717},{"style":857},[2718],{"type":54,"value":2719},"    {\n",{"type":49,"tag":850,"props":2721,"children":2722},{"class":852,"line":1121},[2723,2727,2731,2735,2739,2743,2747,2751],{"type":49,"tag":850,"props":2724,"children":2725},{"style":857},[2726],{"type":54,"value":1873},{"type":49,"tag":850,"props":2728,"children":2729},{"style":1192},[2730],{"type":54,"value":994},{"type":49,"tag":850,"props":2732,"children":2733},{"style":857},[2734],{"type":54,"value":880},{"type":49,"tag":850,"props":2736,"children":2737},{"style":857},[2738],{"type":54,"value":885},{"type":49,"tag":850,"props":2740,"children":2741},{"style":857},[2742],{"type":54,"value":890},{"type":49,"tag":850,"props":2744,"children":2745},{"style":893},[2746],{"type":54,"value":1437},{"type":49,"tag":850,"props":2748,"children":2749},{"style":857},[2750],{"type":54,"value":880},{"type":49,"tag":850,"props":2752,"children":2753},{"style":857},[2754],{"type":54,"value":905},{"type":49,"tag":850,"props":2756,"children":2757},{"class":852,"line":1158},[2758,2762,2766,2770,2774],{"type":49,"tag":850,"props":2759,"children":2760},{"style":857},[2761],{"type":54,"value":1873},{"type":49,"tag":850,"props":2763,"children":2764},{"style":1192},[2765],{"type":54,"value":1458},{"type":49,"tag":850,"props":2767,"children":2768},{"style":857},[2769],{"type":54,"value":880},{"type":49,"tag":850,"props":2771,"children":2772},{"style":857},[2773],{"type":54,"value":885},{"type":49,"tag":850,"props":2775,"children":2776},{"style":857},[2777],{"type":54,"value":1471},{"type":49,"tag":850,"props":2779,"children":2780},{"class":852,"line":1183},[2781,2785,2789,2793,2797,2802],{"type":49,"tag":850,"props":2782,"children":2783},{"style":857},[2784],{"type":54,"value":1873},{"type":49,"tag":850,"props":2786,"children":2787},{"style":1192},[2788],{"type":54,"value":294},{"type":49,"tag":850,"props":2790,"children":2791},{"style":857},[2792],{"type":54,"value":880},{"type":49,"tag":850,"props":2794,"children":2795},{"style":857},[2796],{"type":54,"value":885},{"type":49,"tag":850,"props":2798,"children":2799},{"style":1296},[2800],{"type":54,"value":2801}," 30",{"type":49,"tag":850,"props":2803,"children":2804},{"style":857},[2805],{"type":54,"value":905},{"type":49,"tag":850,"props":2807,"children":2808},{"class":852,"line":1222},[2809,2813,2817,2821,2825,2830,2834,2838,2842,2846,2850,2854,2858,2862,2866,2870,2874,2878,2882,2886,2890],{"type":49,"tag":850,"props":2810,"children":2811},{"style":857},[2812],{"type":54,"value":1873},{"type":49,"tag":850,"props":2814,"children":2815},{"style":1192},[2816],{"type":54,"value":1512},{"type":49,"tag":850,"props":2818,"children":2819},{"style":857},[2820],{"type":54,"value":880},{"type":49,"tag":850,"props":2822,"children":2823},{"style":857},[2824],{"type":54,"value":885},{"type":49,"tag":850,"props":2826,"children":2827},{"style":857},[2828],{"type":54,"value":2829}," [{",{"type":49,"tag":850,"props":2831,"children":2832},{"style":857},[2833],{"type":54,"value":890},{"type":49,"tag":850,"props":2835,"children":2836},{"style":1296},[2837],{"type":54,"value":322},{"type":49,"tag":850,"props":2839,"children":2840},{"style":857},[2841],{"type":54,"value":880},{"type":49,"tag":850,"props":2843,"children":2844},{"style":857},[2845],{"type":54,"value":885},{"type":49,"tag":850,"props":2847,"children":2848},{"style":857},[2849],{"type":54,"value":890},{"type":49,"tag":850,"props":2851,"children":2852},{"style":893},[2853],{"type":54,"value":1559},{"type":49,"tag":850,"props":2855,"children":2856},{"style":857},[2857],{"type":54,"value":880},{"type":49,"tag":850,"props":2859,"children":2860},{"style":857},[2861],{"type":54,"value":1100},{"type":49,"tag":850,"props":2863,"children":2864},{"style":857},[2865],{"type":54,"value":890},{"type":49,"tag":850,"props":2867,"children":2868},{"style":1296},[2869],{"type":54,"value":1576},{"type":49,"tag":850,"props":2871,"children":2872},{"style":857},[2873],{"type":54,"value":880},{"type":49,"tag":850,"props":2875,"children":2876},{"style":857},[2877],{"type":54,"value":885},{"type":49,"tag":850,"props":2879,"children":2880},{"style":857},[2881],{"type":54,"value":890},{"type":49,"tag":850,"props":2883,"children":2884},{"style":893},[2885],{"type":54,"value":1593},{"type":49,"tag":850,"props":2887,"children":2888},{"style":857},[2889],{"type":54,"value":880},{"type":49,"tag":850,"props":2891,"children":2892},{"style":857},[2893],{"type":54,"value":2894}," }]\n",{"type":49,"tag":850,"props":2896,"children":2897},{"class":852,"line":1258},[2898],{"type":49,"tag":850,"props":2899,"children":2900},{"style":857},[2901],{"type":54,"value":1968},{"type":49,"tag":850,"props":2903,"children":2904},{"class":852,"line":1283},[2905],{"type":49,"tag":850,"props":2906,"children":2907},{"style":857},[2908],{"type":54,"value":2719},{"type":49,"tag":850,"props":2910,"children":2911},{"class":852,"line":1326},[2912,2916,2920,2924,2928,2932,2936,2940],{"type":49,"tag":850,"props":2913,"children":2914},{"style":857},[2915],{"type":54,"value":1873},{"type":49,"tag":850,"props":2917,"children":2918},{"style":1192},[2919],{"type":54,"value":994},{"type":49,"tag":850,"props":2921,"children":2922},{"style":857},[2923],{"type":54,"value":880},{"type":49,"tag":850,"props":2925,"children":2926},{"style":857},[2927],{"type":54,"value":885},{"type":49,"tag":850,"props":2929,"children":2930},{"style":857},[2931],{"type":54,"value":890},{"type":49,"tag":850,"props":2933,"children":2934},{"style":893},[2935],{"type":54,"value":1656},{"type":49,"tag":850,"props":2937,"children":2938},{"style":857},[2939],{"type":54,"value":880},{"type":49,"tag":850,"props":2941,"children":2942},{"style":857},[2943],{"type":54,"value":905},{"type":49,"tag":850,"props":2945,"children":2946},{"class":852,"line":1368},[2947,2951,2955,2959,2963],{"type":49,"tag":850,"props":2948,"children":2949},{"style":857},[2950],{"type":54,"value":1873},{"type":49,"tag":850,"props":2952,"children":2953},{"style":1192},[2954],{"type":54,"value":1458},{"type":49,"tag":850,"props":2956,"children":2957},{"style":857},[2958],{"type":54,"value":880},{"type":49,"tag":850,"props":2960,"children":2961},{"style":857},[2962],{"type":54,"value":885},{"type":49,"tag":850,"props":2964,"children":2965},{"style":857},[2966],{"type":54,"value":1689},{"type":49,"tag":850,"props":2968,"children":2969},{"class":852,"line":1377},[2970,2974,2978,2982,2986,2991],{"type":49,"tag":850,"props":2971,"children":2972},{"style":857},[2973],{"type":54,"value":1873},{"type":49,"tag":850,"props":2975,"children":2976},{"style":1192},[2977],{"type":54,"value":294},{"type":49,"tag":850,"props":2979,"children":2980},{"style":857},[2981],{"type":54,"value":880},{"type":49,"tag":850,"props":2983,"children":2984},{"style":857},[2985],{"type":54,"value":885},{"type":49,"tag":850,"props":2987,"children":2988},{"style":1296},[2989],{"type":54,"value":2990}," 70",{"type":49,"tag":850,"props":2992,"children":2993},{"style":857},[2994],{"type":54,"value":905},{"type":49,"tag":850,"props":2996,"children":2997},{"class":852,"line":1401},[2998,3002,3006,3010,3014,3018,3022,3026,3030,3034,3038,3042,3046,3050,3054,3058,3062,3066,3070,3074,3078],{"type":49,"tag":850,"props":2999,"children":3000},{"style":857},[3001],{"type":54,"value":1873},{"type":49,"tag":850,"props":3003,"children":3004},{"style":1192},[3005],{"type":54,"value":1512},{"type":49,"tag":850,"props":3007,"children":3008},{"style":857},[3009],{"type":54,"value":880},{"type":49,"tag":850,"props":3011,"children":3012},{"style":857},[3013],{"type":54,"value":885},{"type":49,"tag":850,"props":3015,"children":3016},{"style":857},[3017],{"type":54,"value":2829},{"type":49,"tag":850,"props":3019,"children":3020},{"style":857},[3021],{"type":54,"value":890},{"type":49,"tag":850,"props":3023,"children":3024},{"style":1296},[3025],{"type":54,"value":322},{"type":49,"tag":850,"props":3027,"children":3028},{"style":857},[3029],{"type":54,"value":880},{"type":49,"tag":850,"props":3031,"children":3032},{"style":857},[3033],{"type":54,"value":885},{"type":49,"tag":850,"props":3035,"children":3036},{"style":857},[3037],{"type":54,"value":890},{"type":49,"tag":850,"props":3039,"children":3040},{"style":893},[3041],{"type":54,"value":1559},{"type":49,"tag":850,"props":3043,"children":3044},{"style":857},[3045],{"type":54,"value":880},{"type":49,"tag":850,"props":3047,"children":3048},{"style":857},[3049],{"type":54,"value":1100},{"type":49,"tag":850,"props":3051,"children":3052},{"style":857},[3053],{"type":54,"value":890},{"type":49,"tag":850,"props":3055,"children":3056},{"style":1296},[3057],{"type":54,"value":1576},{"type":49,"tag":850,"props":3059,"children":3060},{"style":857},[3061],{"type":54,"value":880},{"type":49,"tag":850,"props":3063,"children":3064},{"style":857},[3065],{"type":54,"value":885},{"type":49,"tag":850,"props":3067,"children":3068},{"style":857},[3069],{"type":54,"value":890},{"type":49,"tag":850,"props":3071,"children":3072},{"style":893},[3073],{"type":54,"value":1806},{"type":49,"tag":850,"props":3075,"children":3076},{"style":857},[3077],{"type":54,"value":880},{"type":49,"tag":850,"props":3079,"children":3080},{"style":857},[3081],{"type":54,"value":2894},{"type":49,"tag":850,"props":3083,"children":3084},{"class":852,"line":1410},[3085],{"type":49,"tag":850,"props":3086,"children":3087},{"style":857},[3088],{"type":54,"value":3089},"    }\n",{"type":49,"tag":850,"props":3091,"children":3092},{"class":852,"line":1448},[3093],{"type":49,"tag":850,"props":3094,"children":3095},{"style":857},[3096],{"type":54,"value":3097},"  ],\n",{"type":49,"tag":850,"props":3099,"children":3100},{"class":852,"line":26},[3101,3105,3109,3113,3117],{"type":49,"tag":850,"props":3102,"children":3103},{"style":857},[3104],{"type":54,"value":869},{"type":49,"tag":850,"props":3106,"children":3107},{"style":872},[3108],{"type":54,"value":469},{"type":49,"tag":850,"props":3110,"children":3111},{"style":857},[3112],{"type":54,"value":880},{"type":49,"tag":850,"props":3114,"children":3115},{"style":857},[3116],{"type":54,"value":885},{"type":49,"tag":850,"props":3118,"children":3119},{"style":857},[3120],{"type":54,"value":1280},{"type":49,"tag":850,"props":3122,"children":3123},{"class":852,"line":1502},[3124,3129,3133,3137,3141,3145,3149,3153,3157],{"type":49,"tag":850,"props":3125,"children":3126},{"style":857},[3127],{"type":54,"value":3128},"    {",{"type":49,"tag":850,"props":3130,"children":3131},{"style":857},[3132],{"type":54,"value":890},{"type":49,"tag":850,"props":3134,"children":3135},{"style":1192},[3136],{"type":54,"value":956},{"type":49,"tag":850,"props":3138,"children":3139},{"style":857},[3140],{"type":54,"value":880},{"type":49,"tag":850,"props":3142,"children":3143},{"style":857},[3144],{"type":54,"value":885},{"type":49,"tag":850,"props":3146,"children":3147},{"style":857},[3148],{"type":54,"value":890},{"type":49,"tag":850,"props":3150,"children":3151},{"style":893},[3152],{"type":54,"value":707},{"type":49,"tag":850,"props":3154,"children":3155},{"style":857},[3156],{"type":54,"value":880},{"type":49,"tag":850,"props":3158,"children":3159},{"style":857},[3160],{"type":54,"value":1323},{"type":49,"tag":850,"props":3162,"children":3163},{"class":852,"line":1527},[3164,3168,3172,3176,3180,3184,3188,3192,3196],{"type":49,"tag":850,"props":3165,"children":3166},{"style":857},[3167],{"type":54,"value":3128},{"type":49,"tag":850,"props":3169,"children":3170},{"style":857},[3171],{"type":54,"value":890},{"type":49,"tag":850,"props":3173,"children":3174},{"style":1192},[3175],{"type":54,"value":956},{"type":49,"tag":850,"props":3177,"children":3178},{"style":857},[3179],{"type":54,"value":880},{"type":49,"tag":850,"props":3181,"children":3182},{"style":857},[3183],{"type":54,"value":885},{"type":49,"tag":850,"props":3185,"children":3186},{"style":857},[3187],{"type":54,"value":890},{"type":49,"tag":850,"props":3189,"children":3190},{"style":893},[3191],{"type":54,"value":1356},{"type":49,"tag":850,"props":3193,"children":3194},{"style":857},[3195],{"type":54,"value":880},{"type":49,"tag":850,"props":3197,"children":3198},{"style":857},[3199],{"type":54,"value":1323},{"type":49,"tag":850,"props":3201,"children":3202},{"class":852,"line":1604},[3203,3207,3211,3215,3219,3223,3227,3232,3236],{"type":49,"tag":850,"props":3204,"children":3205},{"style":857},[3206],{"type":54,"value":3128},{"type":49,"tag":850,"props":3208,"children":3209},{"style":857},[3210],{"type":54,"value":890},{"type":49,"tag":850,"props":3212,"children":3213},{"style":1192},[3214],{"type":54,"value":956},{"type":49,"tag":850,"props":3216,"children":3217},{"style":857},[3218],{"type":54,"value":880},{"type":49,"tag":850,"props":3220,"children":3221},{"style":857},[3222],{"type":54,"value":885},{"type":49,"tag":850,"props":3224,"children":3225},{"style":857},[3226],{"type":54,"value":890},{"type":49,"tag":850,"props":3228,"children":3229},{"style":893},[3230],{"type":54,"value":3231},"checkout-error-rate",{"type":49,"tag":850,"props":3233,"children":3234},{"style":857},[3235],{"type":54,"value":880},{"type":49,"tag":850,"props":3237,"children":3238},{"style":857},[3239],{"type":54,"value":1365},{"type":49,"tag":850,"props":3241,"children":3242},{"class":852,"line":1613},[3243],{"type":49,"tag":850,"props":3244,"children":3245},{"style":857},[3246],{"type":54,"value":3247},"  ]\n",{"type":49,"tag":850,"props":3249,"children":3250},{"class":852,"line":1622},[3251],{"type":49,"tag":850,"props":3252,"children":3253},{"style":857},[3254],{"type":54,"value":2021},{"type":49,"tag":265,"props":3256,"children":3258},{"id":3257},"step-7-stop-the-iteration",[3259],{"type":54,"value":3260},"Step 7: Stop the Iteration",{"type":49,"tag":57,"props":3262,"children":3263},{},[3264,3266,3271,3273,3278,3280,3286,3288,3293],{"type":54,"value":3265},"When you've reached significance or made a call, stop the iteration. ",{"type":49,"tag":78,"props":3267,"children":3268},{},[3269],{"type":54,"value":3270},"A winning treatment is required to stop",{"type":54,"value":3272}," — LaunchDarkly does not let you end an iteration without declaring a winner. Pass the winning treatment's id (returned in ",{"type":49,"tag":92,"props":3274,"children":3276},{"className":3275},[],[3277],{"type":54,"value":119},{"type":54,"value":3279}," as ",{"type":49,"tag":92,"props":3281,"children":3283},{"className":3282},[],[3284],{"type":54,"value":3285},"_id",{"type":54,"value":3287}," on each treatment) plus a ",{"type":49,"tag":92,"props":3289,"children":3291},{"className":3290},[],[3292],{"type":54,"value":230},{"type":54,"value":194},{"type":49,"tag":57,"props":3295,"children":3296},{},[3297,3299,3304,3306,3311],{"type":54,"value":3298},"If the experiment was inconclusive or no variation beat the control, declare the ",{"type":49,"tag":78,"props":3300,"children":3301},{},[3302],{"type":54,"value":3303},"baseline\u002Fcontrol treatment as the winner",{"type":54,"value":3305}," and say so in ",{"type":49,"tag":92,"props":3307,"children":3309},{"className":3308},[],[3310],{"type":54,"value":230},{"type":54,"value":3312}," (e.g. \"Inconclusive — no significant lift, keeping control\"). There is no \"stop without a winner\" path.",{"type":49,"tag":839,"props":3314,"children":3316},{"className":841,"code":3315,"language":843,"meta":844,"style":844},"{\n  \"projectKey\": \"my-project\",\n  \"environmentKey\": \"production\",\n  \"experimentKey\": \"checkout-flow-v2-experiment\",\n  \"winningTreatmentId\": \"treat-002\",\n  \"winningReason\": \"Two weeks of data, +4.1% lift on the primary metric with PBBL > 95%.\"\n}\n",[3317],{"type":49,"tag":92,"props":3318,"children":3319},{"__ignoreMap":844},[3320,3327,3362,3397,3432,3468,3500],{"type":49,"tag":850,"props":3321,"children":3322},{"class":852,"line":853},[3323],{"type":49,"tag":850,"props":3324,"children":3325},{"style":857},[3326],{"type":54,"value":860},{"type":49,"tag":850,"props":3328,"children":3329},{"class":852,"line":863},[3330,3334,3338,3342,3346,3350,3354,3358],{"type":49,"tag":850,"props":3331,"children":3332},{"style":857},[3333],{"type":54,"value":869},{"type":49,"tag":850,"props":3335,"children":3336},{"style":872},[3337],{"type":54,"value":875},{"type":49,"tag":850,"props":3339,"children":3340},{"style":857},[3341],{"type":54,"value":880},{"type":49,"tag":850,"props":3343,"children":3344},{"style":857},[3345],{"type":54,"value":885},{"type":49,"tag":850,"props":3347,"children":3348},{"style":857},[3349],{"type":54,"value":890},{"type":49,"tag":850,"props":3351,"children":3352},{"style":893},[3353],{"type":54,"value":896},{"type":49,"tag":850,"props":3355,"children":3356},{"style":857},[3357],{"type":54,"value":880},{"type":49,"tag":850,"props":3359,"children":3360},{"style":857},[3361],{"type":54,"value":905},{"type":49,"tag":850,"props":3363,"children":3364},{"class":852,"line":908},[3365,3369,3373,3377,3381,3385,3389,3393],{"type":49,"tag":850,"props":3366,"children":3367},{"style":857},[3368],{"type":54,"value":869},{"type":49,"tag":850,"props":3370,"children":3371},{"style":872},[3372],{"type":54,"value":918},{"type":49,"tag":850,"props":3374,"children":3375},{"style":857},[3376],{"type":54,"value":880},{"type":49,"tag":850,"props":3378,"children":3379},{"style":857},[3380],{"type":54,"value":885},{"type":49,"tag":850,"props":3382,"children":3383},{"style":857},[3384],{"type":54,"value":890},{"type":49,"tag":850,"props":3386,"children":3387},{"style":893},[3388],{"type":54,"value":935},{"type":49,"tag":850,"props":3390,"children":3391},{"style":857},[3392],{"type":54,"value":880},{"type":49,"tag":850,"props":3394,"children":3395},{"style":857},[3396],{"type":54,"value":905},{"type":49,"tag":850,"props":3398,"children":3399},{"class":852,"line":946},[3400,3404,3408,3412,3416,3420,3424,3428],{"type":49,"tag":850,"props":3401,"children":3402},{"style":857},[3403],{"type":54,"value":869},{"type":49,"tag":850,"props":3405,"children":3406},{"style":872},[3407],{"type":54,"value":2279},{"type":49,"tag":850,"props":3409,"children":3410},{"style":857},[3411],{"type":54,"value":880},{"type":49,"tag":850,"props":3413,"children":3414},{"style":857},[3415],{"type":54,"value":885},{"type":49,"tag":850,"props":3417,"children":3418},{"style":857},[3419],{"type":54,"value":890},{"type":49,"tag":850,"props":3421,"children":3422},{"style":893},[3423],{"type":54,"value":973},{"type":49,"tag":850,"props":3425,"children":3426},{"style":857},[3427],{"type":54,"value":880},{"type":49,"tag":850,"props":3429,"children":3430},{"style":857},[3431],{"type":54,"value":905},{"type":49,"tag":850,"props":3433,"children":3434},{"class":852,"line":984},[3435,3439,3443,3447,3451,3455,3460,3464],{"type":49,"tag":850,"props":3436,"children":3437},{"style":857},[3438],{"type":54,"value":869},{"type":49,"tag":850,"props":3440,"children":3441},{"style":872},[3442],{"type":54,"value":222},{"type":49,"tag":850,"props":3444,"children":3445},{"style":857},[3446],{"type":54,"value":880},{"type":49,"tag":850,"props":3448,"children":3449},{"style":857},[3450],{"type":54,"value":885},{"type":49,"tag":850,"props":3452,"children":3453},{"style":857},[3454],{"type":54,"value":890},{"type":49,"tag":850,"props":3456,"children":3457},{"style":893},[3458],{"type":54,"value":3459},"treat-002",{"type":49,"tag":850,"props":3461,"children":3462},{"style":857},[3463],{"type":54,"value":880},{"type":49,"tag":850,"props":3465,"children":3466},{"style":857},[3467],{"type":54,"value":905},{"type":49,"tag":850,"props":3469,"children":3470},{"class":852,"line":30},[3471,3475,3479,3483,3487,3491,3496],{"type":49,"tag":850,"props":3472,"children":3473},{"style":857},[3474],{"type":54,"value":869},{"type":49,"tag":850,"props":3476,"children":3477},{"style":872},[3478],{"type":54,"value":230},{"type":49,"tag":850,"props":3480,"children":3481},{"style":857},[3482],{"type":54,"value":880},{"type":49,"tag":850,"props":3484,"children":3485},{"style":857},[3486],{"type":54,"value":885},{"type":49,"tag":850,"props":3488,"children":3489},{"style":857},[3490],{"type":54,"value":890},{"type":49,"tag":850,"props":3492,"children":3493},{"style":893},[3494],{"type":54,"value":3495},"Two weeks of data, +4.1% lift on the primary metric with PBBL > 95%.",{"type":49,"tag":850,"props":3497,"children":3498},{"style":857},[3499],{"type":54,"value":2003},{"type":49,"tag":850,"props":3501,"children":3502},{"class":852,"line":1059},[3503],{"type":49,"tag":850,"props":3504,"children":3505},{"style":857},[3506],{"type":54,"value":2021},{"type":49,"tag":57,"props":3508,"children":3509},{},[3510],{"type":49,"tag":78,"props":3511,"children":3512},{},[3513],{"type":54,"value":3514},"Report results:",{"type":49,"tag":84,"props":3516,"children":3517},{},[3518,3530,3535],{"type":49,"tag":88,"props":3519,"children":3520},{},[3521,3523,3528],{"type":54,"value":3522},"Iteration stopped with the declared ",{"type":49,"tag":92,"props":3524,"children":3526},{"className":3525},[],[3527],{"type":54,"value":222},{"type":54,"value":3529}," (the control\u002Fbaseline if inconclusive).",{"type":49,"tag":88,"props":3531,"children":3532},{},[3533],{"type":54,"value":3534},"Lift \u002F significance summary on the primary metric.",{"type":49,"tag":88,"props":3536,"children":3537},{},[3538],{"type":54,"value":3539},"Next steps (ship the winner, roll back, or start a follow-up iteration).",{"type":49,"tag":63,"props":3541,"children":3543},{"id":3542},"edge-cases",[3544],{"type":54,"value":3545},"Edge Cases",{"type":49,"tag":654,"props":3547,"children":3548},{},[3549,3565],{"type":49,"tag":658,"props":3550,"children":3551},{},[3552],{"type":49,"tag":662,"props":3553,"children":3554},{},[3555,3560],{"type":49,"tag":666,"props":3556,"children":3557},{},[3558],{"type":54,"value":3559},"Situation",{"type":49,"tag":666,"props":3561,"children":3562},{},[3563],{"type":54,"value":3564},"Action",{"type":49,"tag":682,"props":3566,"children":3567},{},[3568,3587,3600,3644,3670,3689],{"type":49,"tag":662,"props":3569,"children":3570},{},[3571,3576],{"type":49,"tag":689,"props":3572,"children":3573},{},[3574],{"type":54,"value":3575},"Metric doesn't exist",{"type":49,"tag":689,"props":3577,"children":3578},{},[3579,3581,3586],{"type":54,"value":3580},"Create it first with ",{"type":49,"tag":92,"props":3582,"children":3584},{"className":3583},[],[3585],{"type":54,"value":248},{"type":54,"value":194},{"type":49,"tag":662,"props":3588,"children":3589},{},[3590,3595],{"type":49,"tag":689,"props":3591,"children":3592},{},[3593],{"type":54,"value":3594},"Flag has no variations to compare",{"type":49,"tag":689,"props":3596,"children":3597},{},[3598],{"type":54,"value":3599},"Create flag variations before designing treatments.",{"type":49,"tag":662,"props":3601,"children":3602},{},[3603,3620],{"type":49,"tag":689,"props":3604,"children":3605},{},[3606,3608,3613,3615],{"type":54,"value":3607},"You don't know the flag's ",{"type":49,"tag":92,"props":3609,"children":3611},{"className":3610},[],[3612],{"type":54,"value":329},{"type":54,"value":3614}," \u002F ",{"type":49,"tag":92,"props":3616,"children":3618},{"className":3617},[],[3619],{"type":54,"value":337},{"type":49,"tag":689,"props":3621,"children":3622},{},[3623,3624,3629,3630,3636,3638,3643],{"type":54,"value":605},{"type":49,"tag":92,"props":3625,"children":3627},{"className":3626},[],[3628],{"type":54,"value":802},{"type":54,"value":644},{"type":49,"tag":92,"props":3631,"children":3633},{"className":3632},[],[3634],{"type":54,"value":3635},"get-flag-status-across-envs",{"type":54,"value":3637},". The fallthrough rule's id is the string ",{"type":49,"tag":92,"props":3639,"children":3641},{"className":3640},[],[3642],{"type":54,"value":810},{"type":54,"value":194},{"type":49,"tag":662,"props":3645,"children":3646},{},[3647,3652],{"type":49,"tag":689,"props":3648,"children":3649},{},[3650],{"type":54,"value":3651},"Experiment already exists",{"type":49,"tag":689,"props":3653,"children":3654},{},[3655,3656,3661,3663,3668],{"type":54,"value":605},{"type":49,"tag":92,"props":3657,"children":3659},{"className":3658},[],[3660],{"type":54,"value":141},{"type":54,"value":3662}," to find it; ",{"type":49,"tag":92,"props":3664,"children":3666},{"className":3665},[],[3667],{"type":54,"value":119},{"type":54,"value":3669}," for details.",{"type":49,"tag":662,"props":3671,"children":3672},{},[3673,3678],{"type":49,"tag":689,"props":3674,"children":3675},{},[3676],{"type":54,"value":3677},"Need to change locked fields mid-experiment",{"type":49,"tag":689,"props":3679,"children":3680},{},[3681,3682,3687],{"type":54,"value":605},{"type":49,"tag":92,"props":3683,"children":3685},{"className":3684},[],[3686],{"type":54,"value":203},{"type":54,"value":3688}," (single call) rather than stopping and recreating by hand.",{"type":49,"tag":662,"props":3690,"children":3691},{},[3692,3709],{"type":49,"tag":689,"props":3693,"children":3694},{},[3695,3700,3702,3707],{"type":49,"tag":92,"props":3696,"children":3698},{"className":3697},[],[3699],{"type":54,"value":152},{"type":54,"value":3701}," returns ",{"type":49,"tag":92,"props":3703,"children":3705},{"className":3704},[],[3706],{"type":54,"value":192},{"type":54,"value":3708}," for a field",{"type":49,"tag":689,"props":3710,"children":3711},{},[3712,3714,3720,3722,3728,3730,3735],{"type":54,"value":3713},"Inspect the ",{"type":49,"tag":92,"props":3715,"children":3717},{"className":3716},[],[3718],{"type":54,"value":3719},"currentStatus",{"type":54,"value":3721}," and ",{"type":49,"tag":92,"props":3723,"children":3725},{"className":3724},[],[3726],{"type":54,"value":3727},"allowedFields",{"type":54,"value":3729}," in the response — that field isn't mutable in the current iteration status. Either stop the iteration first or use ",{"type":49,"tag":92,"props":3731,"children":3733},{"className":3732},[],[3734],{"type":54,"value":203},{"type":54,"value":194},{"type":49,"tag":63,"props":3737,"children":3739},{"id":3738},"what-not-to-do",[3740],{"type":54,"value":3741},"What NOT to Do",{"type":49,"tag":84,"props":3743,"children":3744},{},[3745,3764,3776,3788,3814,3819],{"type":49,"tag":88,"props":3746,"children":3747},{},[3748,3750,3755,3757,3762],{"type":54,"value":3749},"Don't omit ",{"type":49,"tag":92,"props":3751,"children":3753},{"className":3752},[],[3754],{"type":54,"value":835},{"type":54,"value":3756}," on ",{"type":49,"tag":92,"props":3758,"children":3760},{"className":3759},[],[3761],{"type":54,"value":97},{"type":54,"value":3763}," — it's required.",{"type":49,"tag":88,"props":3765,"children":3766},{},[3767,3769,3774],{"type":54,"value":3768},"Don't set ",{"type":49,"tag":92,"props":3770,"children":3772},{"className":3771},[],[3773],{"type":54,"value":564},{"type":54,"value":3775}," on more than one treatment.",{"type":49,"tag":88,"props":3777,"children":3778},{},[3779,3781,3786],{"type":54,"value":3780},"Don't let ",{"type":49,"tag":92,"props":3782,"children":3784},{"className":3783},[],[3785],{"type":54,"value":294},{"type":54,"value":3787}," values fail to sum to 100 across treatments.",{"type":49,"tag":88,"props":3789,"children":3790},{},[3791,3793,3798,3800,3805,3807,3812],{"type":54,"value":3792},"Don't try to change locked iteration fields with ",{"type":49,"tag":92,"props":3794,"children":3796},{"className":3795},[],[3797],{"type":54,"value":152},{"type":54,"value":3799}," while the iteration is ",{"type":49,"tag":92,"props":3801,"children":3803},{"className":3802},[],[3804],{"type":54,"value":176},{"type":54,"value":3806}," — reach for ",{"type":49,"tag":92,"props":3808,"children":3810},{"className":3809},[],[3811],{"type":54,"value":203},{"type":54,"value":3813}," instead.",{"type":49,"tag":88,"props":3815,"children":3816},{},[3817],{"type":54,"value":3818},"Don't stop iterations early — wait for statistical significance.",{"type":49,"tag":88,"props":3820,"children":3821},{},[3822],{"type":54,"value":3823},"Don't run multiple experiments on the same flag at the same time without a careful holdout design.",{"type":49,"tag":3825,"props":3826,"children":3827},"style",{},[3828],{"type":54,"value":3829},"html .light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html.light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"items":3831,"total":3959},[3832,3849,3858,3868,3879,3889,3897,3911,3922,3931,3941,3950],{"slug":3833,"name":3833,"fn":3834,"description":3835,"org":3836,"tags":3837,"stars":26,"repoUrl":27,"updatedAt":3848},"agent-graphs","create and manage agent graphs","Create and manage agent graphs — directed graphs of configs connected by edges with handoff logic. Use when building multi-agent workflows where configs route to each other.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3838,3841,3844,3845],{"name":3839,"slug":3840,"type":15},"Agents","agents",{"name":3842,"slug":3843,"type":15},"Architecture","architecture",{"name":9,"slug":8,"type":15},{"name":3846,"slug":3847,"type":15},"Multi-Agent","multi-agent","2026-07-28T05:33:33.709407",{"slug":3850,"name":3850,"fn":3851,"description":3852,"org":3853,"tags":3854,"stars":26,"repoUrl":27,"updatedAt":3857},"aiconfig-agent-graphs","manage agent graphs","DEPRECATED redirect — this skill was renamed to agent-graphs. Do not use this skill; invoke agent-graphs instead. Kept only so old references to aiconfig-agent-graphs still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3855,3856],{"name":3839,"slug":3840,"type":15},{"name":3842,"slug":3843,"type":15},"2026-05-22T06:55:56.527064",{"slug":3859,"name":3859,"fn":3860,"description":3861,"org":3862,"tags":3863,"stars":26,"repoUrl":27,"updatedAt":3867},"aiconfig-ai-metrics","manage built-in AI metrics","DEPRECATED redirect — this skill was renamed to built-in-metrics. Do not use this skill; invoke built-in-metrics instead. Kept only so old references to aiconfig-ai-metrics still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3864,3865,3866],{"name":20,"slug":21,"type":15},{"name":9,"slug":8,"type":15},{"name":304,"slug":469,"type":15},"2026-05-22T06:55:53.858749",{"slug":3869,"name":3869,"fn":3870,"description":3871,"org":3872,"tags":3873,"stars":26,"repoUrl":27,"updatedAt":3878},"aiconfig-create","redirect to configs-create skill","DEPRECATED redirect — this skill was renamed to configs-create. Do not use this skill; invoke configs-create instead. Kept only so old references to aiconfig-create still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3874,3875],{"name":9,"slug":8,"type":15},{"name":3876,"slug":3877,"type":15},"Reference","reference","2026-05-22T06:55:41.790591",{"slug":3880,"name":3880,"fn":3881,"description":3882,"org":3883,"tags":3884,"stars":26,"repoUrl":27,"updatedAt":3888},"aiconfig-custom-metrics","configure custom metrics in LaunchDarkly","DEPRECATED redirect — this skill was renamed to custom-metrics. Do not use this skill; invoke custom-metrics instead. Kept only so old references to aiconfig-custom-metrics still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3885,3886,3887],{"name":20,"slug":21,"type":15},{"name":13,"slug":14,"type":15},{"name":9,"slug":8,"type":15},"2026-05-22T06:55:57.84851",{"slug":3890,"name":3890,"fn":3891,"description":3892,"org":3893,"tags":3894,"stars":26,"repoUrl":27,"updatedAt":3896},"aiconfig-migrate","redirect to migrate skill","DEPRECATED redirect — this skill was renamed to migrate. Do not use this skill; invoke migrate instead. Kept only so old references to aiconfig-migrate still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3895],{"name":3876,"slug":3877,"type":15},"2026-05-22T06:55:44.464733",{"slug":3898,"name":3898,"fn":3899,"description":3900,"org":3901,"tags":3902,"stars":26,"repoUrl":27,"updatedAt":3910},"aiconfig-online-evals","run online evaluations","DEPRECATED redirect — this skill was renamed to online-evals. Do not use this skill; invoke online-evals instead. Kept only so old references to aiconfig-online-evals still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3903,3906,3907],{"name":3904,"slug":3905,"type":15},"Evals","evals",{"name":9,"slug":8,"type":15},{"name":3908,"slug":3909,"type":15},"Testing","testing","2026-05-22T06:55:55.179617",{"slug":3912,"name":3912,"fn":3913,"description":3914,"org":3915,"tags":3916,"stars":26,"repoUrl":27,"updatedAt":3921},"aiconfig-projects","manage AI configuration projects","DEPRECATED redirect — this skill was renamed to projects. Do not use this skill; invoke projects instead. Kept only so old references to aiconfig-projects still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3917,3920],{"name":3918,"slug":3919,"type":15},"Configuration","configuration",{"name":9,"slug":8,"type":15},"2026-05-22T06:55:48.522229",{"slug":3923,"name":3923,"fn":3924,"description":3925,"org":3926,"tags":3927,"stars":26,"repoUrl":27,"updatedAt":3930},"aiconfig-snippets","manage AI configuration snippets","DEPRECATED redirect — this skill was renamed to snippets. Do not use this skill; invoke snippets instead. Kept only so old references to aiconfig-snippets still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3928,3929],{"name":3918,"slug":3919,"type":15},{"name":9,"slug":8,"type":15},"2026-05-22T06:55:47.16557",{"slug":3932,"name":3932,"fn":3933,"description":3934,"org":3935,"tags":3936,"stars":26,"repoUrl":27,"updatedAt":3940},"aiconfig-targeting","configure LaunchDarkly targeting rules","DEPRECATED redirect — this skill was renamed to configs-targeting. Do not use this skill; invoke configs-targeting instead. Kept only so old references to aiconfig-targeting still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3937,3938,3939],{"name":3918,"slug":3919,"type":15},{"name":13,"slug":14,"type":15},{"name":9,"slug":8,"type":15},"2026-05-22T06:55:49.845445",{"slug":3942,"name":3942,"fn":3943,"description":3944,"org":3945,"tags":3946,"stars":26,"repoUrl":27,"updatedAt":3949},"aiconfig-tools","redirect to tools skill","DEPRECATED redirect — this skill was renamed to tools. Do not use this skill; invoke tools instead. Kept only so old references to aiconfig-tools still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3947,3948],{"name":9,"slug":8,"type":15},{"name":3876,"slug":3877,"type":15},"2026-05-22T06:55:39.13373",{"slug":3951,"name":3951,"fn":3952,"description":3953,"org":3954,"tags":3955,"stars":26,"repoUrl":27,"updatedAt":3958},"aiconfig-update","redirect to configs-update skill","DEPRECATED redirect — this skill was renamed to configs-update. Do not use this skill; invoke configs-update instead. Kept only so old references to aiconfig-update still point users to the new name.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3956,3957],{"name":9,"slug":8,"type":15},{"name":3876,"slug":3877,"type":15},"2026-05-22T06:55:40.464884",49,{"items":3961,"total":3959},[3962,3969,3974,3980,3985,3991,3995],{"slug":3833,"name":3833,"fn":3834,"description":3835,"org":3963,"tags":3964,"stars":26,"repoUrl":27,"updatedAt":3848},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3965,3966,3967,3968],{"name":3839,"slug":3840,"type":15},{"name":3842,"slug":3843,"type":15},{"name":9,"slug":8,"type":15},{"name":3846,"slug":3847,"type":15},{"slug":3850,"name":3850,"fn":3851,"description":3852,"org":3970,"tags":3971,"stars":26,"repoUrl":27,"updatedAt":3857},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3972,3973],{"name":3839,"slug":3840,"type":15},{"name":3842,"slug":3843,"type":15},{"slug":3859,"name":3859,"fn":3860,"description":3861,"org":3975,"tags":3976,"stars":26,"repoUrl":27,"updatedAt":3867},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3977,3978,3979],{"name":20,"slug":21,"type":15},{"name":9,"slug":8,"type":15},{"name":304,"slug":469,"type":15},{"slug":3869,"name":3869,"fn":3870,"description":3871,"org":3981,"tags":3982,"stars":26,"repoUrl":27,"updatedAt":3878},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3983,3984],{"name":9,"slug":8,"type":15},{"name":3876,"slug":3877,"type":15},{"slug":3880,"name":3880,"fn":3881,"description":3882,"org":3986,"tags":3987,"stars":26,"repoUrl":27,"updatedAt":3888},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3988,3989,3990],{"name":20,"slug":21,"type":15},{"name":13,"slug":14,"type":15},{"name":9,"slug":8,"type":15},{"slug":3890,"name":3890,"fn":3891,"description":3892,"org":3992,"tags":3993,"stars":26,"repoUrl":27,"updatedAt":3896},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3994],{"name":3876,"slug":3877,"type":15},{"slug":3898,"name":3898,"fn":3899,"description":3900,"org":3996,"tags":3997,"stars":26,"repoUrl":27,"updatedAt":3910},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[3998,3999,4000],{"name":3904,"slug":3905,"type":15},{"name":9,"slug":8,"type":15},{"name":3908,"slug":3909,"type":15}]