[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill-cockroachdb-collecting-cockroachdb-operator-escalation-packet":3,"mdc--6pev99-key":36,"related-repo-cockroachdb-collecting-cockroachdb-operator-escalation-packet":4343,"related-org-cockroachdb-collecting-cockroachdb-operator-escalation-packet":4413},{"slug":4,"name":4,"fn":5,"description":6,"org":7,"tags":11,"stars":25,"repoUrl":26,"updatedAt":27,"license":28,"forks":29,"topics":30,"repo":31,"sourceUrl":34,"mdContent":35},"collecting-cockroachdb-operator-escalation-packet","collect CockroachDB operator escalation packets","Collects a complete CockroachDB Operator escalation packet for TSC\u002FTSE or operator-team handoff, including Helm state, Kubernetes resources, logs, operation-specific evidence, pprof goroutine dumps, metrics, and a customer action timeline. Use when general diagnosis cannot resolve an operator-managed CockroachDB Helm issue or before restarting a stuck operator.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},"cockroachdb","CockroachDB","https:\u002F\u002Fpexgzepcugksgbtrxkhf.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Forg-logos\u002Fcockroachdb.png",[12,16,19,22],{"name":13,"slug":14,"type":15},"Monitoring","monitoring","tag",{"name":17,"slug":18,"type":15},"Incident Response","incident-response",{"name":20,"slug":21,"type":15},"Database","database",{"name":23,"slug":24,"type":15},"Kubernetes","kubernetes",105,"https:\u002F\u002Fgithub.com\u002Fcockroachdb\u002Fhelm-charts","2026-07-12T07:57:25.288146",null,153,[],{"repoUrl":26,"stars":25,"forks":29,"topics":32,"description":33},[],"Helm charts for cockroachdb","https:\u002F\u002Fgithub.com\u002Fcockroachdb\u002Fhelm-charts\u002Ftree\u002FHEAD\u002Fskills\u002Fcockroachdb-observability-and-diagnostics\u002Fcollecting-cockroachdb-operator-escalation-packet","---\nname: collecting-cockroachdb-operator-escalation-packet\ndescription: Collects a complete CockroachDB Operator escalation packet for TSC\u002FTSE or operator-team handoff, including Helm state, Kubernetes resources, logs, operation-specific evidence, pprof goroutine dumps, metrics, and a customer action timeline. Use when general diagnosis cannot resolve an operator-managed CockroachDB Helm issue or before restarting a stuck operator.\ncompatibility: CockroachDB Helm v2 charts and operator-managed crdb.cockroachlabs.com\u002Fv1beta1 resources. Requires Kubernetes read access to the operator namespace and CockroachDB namespace; pprof and metrics collection require port-forward access to the operator Deployment.\nmetadata:\n author: cockroachdb\n version: \"1.0\"\n---\n\n# Collecting CockroachDB Operator Escalation Packet\n\nCollects the artifacts needed for TSC\u002FTSE or operator-team escalation. Use this after basic diagnosis identifies an unresolved operator, Kubernetes, migration, upgrade, scale, DNS, PVC, or certificate issue. Keep collection read-only unless the customer explicitly approves a mitigation.\n\n## When to Use This Skill\n\n- A customer needs to escalate an operator-managed CockroachDB Helm issue to TSC\n- The operator is running but not reconciling and logs\u002Fstatus do not explain why\n- A rollout, upgrade, migration, or scale operation is stuck\n- Operator logs do not explain the failure\n- TSC needs consistent artifacts before advising restart, rollback, manual decommission, or status repair\n\n## Safety Considerations\n\n- Collect this packet before restarting, scaling, or deleting the operator during active operations.\n- Do not delete `CrdbNode`, PVC, Secret, service, version checker job, or StatefulSet resources while collecting data.\n- Do not print private key contents. Collect only Secret names, keys, certificate metadata, expiry, issuer, subject, and SANs.\n- Do not manually edit `CrdbCluster.status`.\n- Do not run `cockroach init` on an existing cluster.\n- If the operator is paused or disabled, record that state before changing anything.\n\n## Execution Discipline\n\n- Execute one step at a time and inspect the output before moving on. Do not run the packet collection in parallel; earlier results determine which operation-specific sections are relevant.\n- Keep collection read-only unless the user explicitly approves a mutating action for the target cluster.\n- Do not run interactive `kubectl exec` shells, `kubectl debug`, port-forwards, pprof\u002Fmetrics collection, or commands that use external images in production unless the user approves them. If impact or policy is unclear, involve TSE or the operator team first.\n- Do not patch, annotate, delete, restart, scale, drain, decommission, or run `helm upgrade` as part of packet collection.\n\n## Required Inputs\n\n- Operator namespace and Helm release\n- CockroachDB namespace and Helm release\n- Kubernetes context and cluster\u002Fprovider\n- Current operation: install, upgrade, scale up\u002Fdown, cert rotation, migration, routine maintenance, or recovery\n- Current and target CockroachDB image, if an upgrade is involved\n- Customer timeline: what changed, what commands were run, and what was already tried\n\n## Packet Layout\n\nAsk the customer to gather outputs into a single directory:\n\n```bash\nmkdir -p crdb-operator-escalation\n```\n\nUse clear filenames, for example `operator-logs.txt`, `crdbcluster.yaml`, `events.txt`, `goroutine_dump.txt`, and `metrics_dump.txt`.\n\n## Step 1: Context and Version Inventory\n\n```bash\nkubectl config current-context > crdb-operator-escalation\u002Fkube-context.txt\nkubectl version --short > crdb-operator-escalation\u002Fkubernetes-version.txt\n\nhelm -n \u003Coperator-namespace> status \u003Coperator-release> > crdb-operator-escalation\u002Foperator-helm-status.txt 2>&1 || true\nhelm -n \u003Coperator-namespace> history \u003Coperator-release> > crdb-operator-escalation\u002Foperator-helm-history.txt 2>&1 || true\nhelm -n \u003Ccockroachdb-namespace> status \u003Ccockroachdb-release> > crdb-operator-escalation\u002Fcrdb-helm-status.txt 2>&1 || true\nhelm -n \u003Ccockroachdb-namespace> history \u003Ccockroachdb-release> > crdb-operator-escalation\u002Fcrdb-helm-history.txt 2>&1 || true\n\nkubectl -n \u003Coperator-namespace> get deploy cockroach-operator -o jsonpath='{.spec.template.spec.containers[0].image}{\"\\n\"}' > crdb-operator-escalation\u002Foperator-image.txt\nkubectl get crd crdbclusters.crdb.cockroachlabs.com crdbnodes.crdb.cockroachlabs.com -o wide > crdb-operator-escalation\u002Fcrds.txt\nkubectl get crd crdbclusters.crdb.cockroachlabs.com -o yaml > crdb-operator-escalation\u002Fcrdbclusters-crd.yaml\nkubectl get crd crdbnodes.crdb.cockroachlabs.com -o yaml > crdb-operator-escalation\u002Fcrdbnodes-crd.yaml\n```\n\nGet the CockroachDB version from a Ready pod:\n\n```bash\nkubectl -n \u003Ccockroachdb-namespace> exec \u003Cready-crdb-pod> -c cockroachdb -- \\\n \u002Fcockroach\u002Fcockroach version > crdb-operator-escalation\u002Fcrdb-version.txt 2>&1\n```\n\n## Step 2: Resource Specifications and Status\n\n```bash\nkubectl -n \u003Coperator-namespace> get deploy,pod,svc,endpoints -o wide > crdb-operator-escalation\u002Foperator-resources.txt\nkubectl -n \u003Coperator-namespace> describe deploy cockroach-operator > crdb-operator-escalation\u002Foperator-deploy-describe.txt\nkubectl -n \u003Coperator-namespace> describe pods -l app=cockroach-operator > crdb-operator-escalation\u002Foperator-pods-describe.txt\nkubectl -n \u003Coperator-namespace> get deploy cockroach-operator -o yaml > crdb-operator-escalation\u002Foperator-deploy.yaml\n\nkubectl -n \u003Ccockroachdb-namespace> get crdbcluster \u003Ccockroachdb-release> -o yaml > crdb-operator-escalation\u002Fcrdbcluster.yaml\nkubectl -n \u003Ccockroachdb-namespace> describe crdbcluster \u003Ccockroachdb-release> > crdb-operator-escalation\u002Fcrdbcluster-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> get crdbnodes -o yaml > crdb-operator-escalation\u002Fcrdbnodes.yaml\nkubectl -n \u003Ccockroachdb-namespace> describe crdbnodes > crdb-operator-escalation\u002Fcrdbnodes-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> get pod,svc,endpoints,pvc,pdb -o wide > crdb-operator-escalation\u002Fcrdb-resources-wide.txt\nkubectl -n \u003Ccockroachdb-namespace> describe pods -l app.kubernetes.io\u002Fname=cockroachdb > crdb-operator-escalation\u002Fcrdb-pods-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> describe pvc > crdb-operator-escalation\u002Fpvc-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> describe pdb > crdb-operator-escalation\u002Fpdb-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> get events --sort-by=.lastTimestamp > crdb-operator-escalation\u002Fevents.txt\n```\n\nSummarize key cluster status:\n\n```bash\nkubectl -n \u003Ccockroachdb-namespace> get crdbcluster \u003Ccockroachdb-release> -o json | jq '{\n mode: .spec.mode,\n nodes: [.spec.regions[]?.nodes],\n regions: .spec.regions,\n image: .spec.image,\n generation: .metadata.generation,\n observedGeneration: .status.observedGeneration,\n statusImage: .status.image,\n actions: .status.actions,\n conditions: .status.conditions,\n labels: .metadata.labels,\n annotations: .metadata.annotations\n}' > crdb-operator-escalation\u002Fcrdbcluster-summary.json\n\nkubectl -n \u003Ccockroachdb-namespace> get crdbnodes \\\n -o custom-columns=NAME:.metadata.name,GENERATION:.metadata.generation,OBSERVED:.status.observedGeneration,PHASE:.status.phase,HASH:.metadata.annotations[\"crdb.cockroachlabs.com\u002Fhash-revision\"],NODE_ID:.status.nodeID \\\n > crdb-operator-escalation\u002Fcrdbnodes-summary.txt\n```\n\n## Step 3: Logs\n\nCollect full recent logs, not filtered snippets:\n\n```bash\nkubectl -n \u003Coperator-namespace> logs -l app=cockroach-operator --tail=500 > crdb-operator-escalation\u002Foperator-logs.txt 2>&1\nkubectl -n \u003Coperator-namespace> logs -l app=cockroach-operator --previous --tail=500 > crdb-operator-escalation\u002Foperator-previous-logs.txt 2>&1 || true\n```\n\nFor each CockroachDB pod:\n\n```bash\nkubectl -n \u003Ccockroachdb-namespace> logs \u003Ccrdb-pod> -c cockroachdb --tail=500 > crdb-operator-escalation\u002F\u003Ccrdb-pod>-cockroachdb.log 2>&1\nkubectl -n \u003Ccockroachdb-namespace> logs \u003Ccrdb-pod> -c cockroachdb --previous --tail=500 > crdb-operator-escalation\u002F\u003Ccrdb-pod>-cockroachdb-previous.log 2>&1 || true\nkubectl -n \u003Ccockroachdb-namespace> logs \u003Ccrdb-pod> -c cert-reloader --tail=100 > crdb-operator-escalation\u002F\u003Ccrdb-pod>-cert-reloader.log 2>&1 || true\n```\n\n## Step 4: Operation-Specific Evidence\n\n### Upgrade\n\n```bash\nkubectl -n \u003Ccockroachdb-namespace> get crdbcluster \u003Ccockroachdb-release> -o json | jq '{\n specImage: .spec.image,\n statusImage: .status.image,\n actions: .status.actions,\n annotations: .metadata.annotations,\n conditions: [.status.conditions[]? | select(.type | test(\"Upgrade|Version|Validate\"))]\n}' > crdb-operator-escalation\u002Fupgrade-status.json\n\nkubectl -n \u003Ccockroachdb-namespace> get jobs -o wide > crdb-operator-escalation\u002Fjobs.txt\nkubectl -n \u003Ccockroachdb-namespace> get pods -o custom-columns=NAME:.metadata.name,IMAGE:.spec.containers[0].image,PHASE:.status.phase > crdb-operator-escalation\u002Fpod-images.txt\nkubectl -n \u003Ccockroachdb-namespace> describe job \u003Cversion-checker-job> > crdb-operator-escalation\u002Fversion-checker-job.txt 2>&1 || true\nkubectl -n \u003Ccockroachdb-namespace> logs -l job-name=\u003Cversion-checker-job> > crdb-operator-escalation\u002Fversion-checker-logs.txt 2>&1 || true\n```\n\nInclude current and target CRDB image and whether any version checker job or pod was deleted.\n\n### Scale Down or Decommission\n\n```bash\nkubectl -n \u003Ccockroachdb-namespace> exec \u003Cready-crdb-pod> -c cockroachdb -- \\\n \u002Fcockroach\u002Fcockroach node status --decommission > crdb-operator-escalation\u002Fnode-decommission-status.txt 2>&1\n\nkubectl -n \u003Ccockroachdb-namespace> get crdbnodes -o json | jq '[.items[] | select(.status.phase==\"Decommissioning\")] | {count: length, nodes: [.[].metadata.name]}' \\\n > crdb-operator-escalation\u002Fdecommissioning-crdbnodes.json\n```\n\nInclude original and target node count, whether multiple nodes changed at once, and whether manual drain\u002Fdecommission was attempted.\n\n### Scale Up\n\nCapture whether machines, Kubernetes nodes, disks, storage classes, topology spread constraints, or node labels changed:\n\n```bash\nkubectl get nodes -L topology.kubernetes.io\u002Fregion,topology.kubernetes.io\u002Fzone > crdb-operator-escalation\u002Fnodes-locality.txt\nkubectl get storageclass > crdb-operator-escalation\u002Fstorageclasses.txt\nkubectl -n \u003Ccockroachdb-namespace> get pvc -o wide > crdb-operator-escalation\u002Fpvc-wide.txt\n```\n\n### Certificate Rotation\n\n```bash\nkubectl -n \u003Ccockroachdb-namespace> get secret,configmap | grep -E 'ca|node|client|tls|cert' > crdb-operator-escalation\u002Fcert-resources.txt || true\nkubectl -n \u003Ccockroachdb-namespace> get certificate,issuer,clusterissuer -o wide > crdb-operator-escalation\u002Fcert-manager-resources.txt 2>&1 || true\n\nkubectl -n \u003Ccockroachdb-namespace> get secret \u003Cnode-tls-secret> -o jsonpath='{.data.tls\\.crt}' | base64 -d | \\\n openssl x509 -noout -dates -subject -issuer -ext subjectAltName > crdb-operator-escalation\u002Fnode-cert-metadata.txt\n```\n\nDo not collect private key values.\n\n### Migration\n\nUse [debugging-cockroachdb-operator-migrations](..\u002F..\u002Fcockroachdb-onboarding-and-migrations\u002Fdebugging-cockroachdb-operator-migrations\u002FSKILL.md) and attach its migration state output. Include source StatefulSet or v1alpha1 `CrdbCluster`, migration labels, migration phase, source ownerReferences, and migration controller logs.\n\n## Step 5: Operator pprof and Metrics\n\nCollect these when the operator is running but not reconciling, logs\u002Fstatus do not explain why, or a worker may be blocked. In production or restricted environments, confirm with the customer, TSE, or the operator team before opening port-forwards.\n\nIn one terminal:\n\n```bash\nkubectl -n \u003Coperator-namespace> port-forward deployment\u002Fcockroach-operator 7080:7080\n```\n\nIn another terminal:\n\n```bash\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fgoroutine?debug=2' > crdb-operator-escalation\u002Fgoroutine_dump.txt\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fgoroutine?debug=1' > crdb-operator-escalation\u002Fgoroutine_summary.txt\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fheap' > crdb-operator-escalation\u002Fheap.prof\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fprofile?seconds=30' > crdb-operator-escalation\u002Fcpu.prof\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fmutex' > crdb-operator-escalation\u002Fmutex.prof\n```\n\nMetrics:\n\n```bash\nkubectl -n \u003Coperator-namespace> port-forward deployment\u002Fcockroach-operator 8080:8080\ncurl -s http:\u002F\u002Flocalhost:8080\u002Fmetrics > crdb-operator-escalation\u002Fmetrics_dump.txt\ngrep 'controller_runtime_reconcile_total' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Freconcile-total.txt || true\ngrep 'controller_runtime_reconcile_errors_total' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Freconcile-errors.txt || true\ngrep 'workqueue_depth' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Fworkqueue-depth.txt || true\ngrep 'workqueue_longest_running_processor_seconds' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Fworkqueue-longest-running.txt || true\ngrep 'workqueue_unfinished_work_seconds' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Fworkqueue-unfinished.txt || true\n```\n\nWhat TSC should inspect:\n\n- `processNextWorkItem` followed by `Reconcile` and a long-running call in `goroutine_dump.txt`\n- `kube.(*Ctl).Exec`, `cockroach init`, HTTP calls, or mutex waits with long durations\n- increasing `workqueue_longest_running_processor_seconds`\n- growing `workqueue_depth`\n- no reconcile count movement for a controller that should be active\n\n## Step 6: Timeline\n\nCreate `crdb-operator-escalation\u002Ftimeline.md` with:\n\n- When the issue started\n- What operation was in progress\n- What docs or runbooks were followed\n- Whether VMs, Kubernetes nodes, disks, storage classes, certs, network policies, or Helm values changed\n- Every manual delete, patch, edit, restart, drain, decommission, or Helm command, in order\n- What is currently serving traffic and what is unavailable\n- Customer restrictions, such as no cluster-admin, no debug containers, no external images, or private registry only\n\n## Step 7: Escalation Summary\n\nReturn a concise summary with:\n\n1. Operation type and current impact\n2. Current operator and CockroachDB versions\n3. Current `CrdbCluster` mode, generation, observedGeneration, status image, and actions\n4. Stuck resource or symptom\n5. Any unsafe operations already performed\n6. Missing artifacts, if any\n7. Whether pprof\u002Fmetrics suggest a blocked worker\n\n## References\n\n- [diagnosing-cockroachdb-helm-deployments](..\u002Fdiagnosing-cockroachdb-helm-deployments\u002FSKILL.md)\n- [debugging-cockroachdb-operator-migrations](..\u002F..\u002Fcockroachdb-onboarding-and-migrations\u002Fdebugging-cockroachdb-operator-migrations\u002FSKILL.md)\n- [CockroachDB Helm Chart Changelog](..\u002F..\u002F..\u002FCHANGELOG.md)\n",{"data":37,"body":41},{"name":4,"description":6,"compatibility":38,"metadata":39},"CockroachDB Helm v2 charts and operator-managed crdb.cockroachlabs.com\u002Fv1beta1 resources. Requires Kubernetes read access to the operator namespace and CockroachDB namespace; pprof and metrics collection require port-forward access to the operator Deployment.",{"author":8,"version":40},"1.0",{"type":42,"children":43},"root",[44,52,58,65,95,101,159,165,212,218,251,257,262,296,338,344,913,918,1021,1027,1728,1733,2027,2033,2038,2172,2177,2485,2491,2498,2903,2908,2914,3105,3110,3116,3121,3240,3246,3554,3559,3565,3587,3593,3598,3603,3652,3657,3831,3836,4115,4120,4189,4195,4208,4246,4252,4257,4303,4309,4337],{"type":45,"tag":46,"props":47,"children":48},"element","h1",{"id":4},[49],{"type":50,"value":51},"text","Collecting CockroachDB Operator Escalation Packet",{"type":45,"tag":53,"props":54,"children":55},"p",{},[56],{"type":50,"value":57},"Collects the artifacts needed for TSC\u002FTSE or operator-team escalation. Use this after basic diagnosis identifies an unresolved operator, Kubernetes, migration, upgrade, scale, DNS, PVC, or certificate issue. Keep collection read-only unless the customer explicitly approves a mitigation.",{"type":45,"tag":59,"props":60,"children":62},"h2",{"id":61},"when-to-use-this-skill",[63],{"type":50,"value":64},"When to Use This Skill",{"type":45,"tag":66,"props":67,"children":68},"ul",{},[69,75,80,85,90],{"type":45,"tag":70,"props":71,"children":72},"li",{},[73],{"type":50,"value":74},"A customer needs to escalate an operator-managed CockroachDB Helm issue to TSC",{"type":45,"tag":70,"props":76,"children":77},{},[78],{"type":50,"value":79},"The operator is running but not reconciling and logs\u002Fstatus do not explain why",{"type":45,"tag":70,"props":81,"children":82},{},[83],{"type":50,"value":84},"A rollout, upgrade, migration, or scale operation is stuck",{"type":45,"tag":70,"props":86,"children":87},{},[88],{"type":50,"value":89},"Operator logs do not explain the failure",{"type":45,"tag":70,"props":91,"children":92},{},[93],{"type":50,"value":94},"TSC needs consistent artifacts before advising restart, rollback, manual decommission, or status repair",{"type":45,"tag":59,"props":96,"children":98},{"id":97},"safety-considerations",[99],{"type":50,"value":100},"Safety Considerations",{"type":45,"tag":66,"props":102,"children":103},{},[104,109,123,128,141,154],{"type":45,"tag":70,"props":105,"children":106},{},[107],{"type":50,"value":108},"Collect this packet before restarting, scaling, or deleting the operator during active operations.",{"type":45,"tag":70,"props":110,"children":111},{},[112,114,121],{"type":50,"value":113},"Do not delete ",{"type":45,"tag":115,"props":116,"children":118},"code",{"className":117},[],[119],{"type":50,"value":120},"CrdbNode",{"type":50,"value":122},", PVC, Secret, service, version checker job, or StatefulSet resources while collecting data.",{"type":45,"tag":70,"props":124,"children":125},{},[126],{"type":50,"value":127},"Do not print private key contents. Collect only Secret names, keys, certificate metadata, expiry, issuer, subject, and SANs.",{"type":45,"tag":70,"props":129,"children":130},{},[131,133,139],{"type":50,"value":132},"Do not manually edit ",{"type":45,"tag":115,"props":134,"children":136},{"className":135},[],[137],{"type":50,"value":138},"CrdbCluster.status",{"type":50,"value":140},".",{"type":45,"tag":70,"props":142,"children":143},{},[144,146,152],{"type":50,"value":145},"Do not run ",{"type":45,"tag":115,"props":147,"children":149},{"className":148},[],[150],{"type":50,"value":151},"cockroach init",{"type":50,"value":153}," on an existing cluster.",{"type":45,"tag":70,"props":155,"children":156},{},[157],{"type":50,"value":158},"If the operator is paused or disabled, record that state before changing anything.",{"type":45,"tag":59,"props":160,"children":162},{"id":161},"execution-discipline",[163],{"type":50,"value":164},"Execution Discipline",{"type":45,"tag":66,"props":166,"children":167},{},[168,173,178,199],{"type":45,"tag":70,"props":169,"children":170},{},[171],{"type":50,"value":172},"Execute one step at a time and inspect the output before moving on. Do not run the packet collection in parallel; earlier results determine which operation-specific sections are relevant.",{"type":45,"tag":70,"props":174,"children":175},{},[176],{"type":50,"value":177},"Keep collection read-only unless the user explicitly approves a mutating action for the target cluster.",{"type":45,"tag":70,"props":179,"children":180},{},[181,183,189,191,197],{"type":50,"value":182},"Do not run interactive ",{"type":45,"tag":115,"props":184,"children":186},{"className":185},[],[187],{"type":50,"value":188},"kubectl exec",{"type":50,"value":190}," shells, ",{"type":45,"tag":115,"props":192,"children":194},{"className":193},[],[195],{"type":50,"value":196},"kubectl debug",{"type":50,"value":198},", port-forwards, pprof\u002Fmetrics collection, or commands that use external images in production unless the user approves them. If impact or policy is unclear, involve TSE or the operator team first.",{"type":45,"tag":70,"props":200,"children":201},{},[202,204,210],{"type":50,"value":203},"Do not patch, annotate, delete, restart, scale, drain, decommission, or run ",{"type":45,"tag":115,"props":205,"children":207},{"className":206},[],[208],{"type":50,"value":209},"helm upgrade",{"type":50,"value":211}," as part of packet collection.",{"type":45,"tag":59,"props":213,"children":215},{"id":214},"required-inputs",[216],{"type":50,"value":217},"Required Inputs",{"type":45,"tag":66,"props":219,"children":220},{},[221,226,231,236,241,246],{"type":45,"tag":70,"props":222,"children":223},{},[224],{"type":50,"value":225},"Operator namespace and Helm release",{"type":45,"tag":70,"props":227,"children":228},{},[229],{"type":50,"value":230},"CockroachDB namespace and Helm release",{"type":45,"tag":70,"props":232,"children":233},{},[234],{"type":50,"value":235},"Kubernetes context and cluster\u002Fprovider",{"type":45,"tag":70,"props":237,"children":238},{},[239],{"type":50,"value":240},"Current operation: install, upgrade, scale up\u002Fdown, cert rotation, migration, routine maintenance, or recovery",{"type":45,"tag":70,"props":242,"children":243},{},[244],{"type":50,"value":245},"Current and target CockroachDB image, if an upgrade is involved",{"type":45,"tag":70,"props":247,"children":248},{},[249],{"type":50,"value":250},"Customer timeline: what changed, what commands were run, and what was already tried",{"type":45,"tag":59,"props":252,"children":254},{"id":253},"packet-layout",[255],{"type":50,"value":256},"Packet Layout",{"type":45,"tag":53,"props":258,"children":259},{},[260],{"type":50,"value":261},"Ask the customer to gather outputs into a single directory:",{"type":45,"tag":263,"props":264,"children":269},"pre",{"className":265,"code":266,"language":267,"meta":268,"style":268},"language-bash shiki shiki-themes material-theme-lighter material-theme material-theme-palenight","mkdir -p crdb-operator-escalation\n","bash","",[270],{"type":45,"tag":115,"props":271,"children":272},{"__ignoreMap":268},[273],{"type":45,"tag":274,"props":275,"children":278},"span",{"class":276,"line":277},"line",1,[279,285,291],{"type":45,"tag":274,"props":280,"children":282},{"style":281},"--shiki-light:#E2931D;--shiki-default:#FFCB6B;--shiki-dark:#FFCB6B",[283],{"type":50,"value":284},"mkdir",{"type":45,"tag":274,"props":286,"children":288},{"style":287},"--shiki-light:#91B859;--shiki-default:#C3E88D;--shiki-dark:#C3E88D",[289],{"type":50,"value":290}," -p",{"type":45,"tag":274,"props":292,"children":293},{"style":287},[294],{"type":50,"value":295}," crdb-operator-escalation\n",{"type":45,"tag":53,"props":297,"children":298},{},[299,301,307,309,315,316,322,323,329,331,337],{"type":50,"value":300},"Use clear filenames, for example ",{"type":45,"tag":115,"props":302,"children":304},{"className":303},[],[305],{"type":50,"value":306},"operator-logs.txt",{"type":50,"value":308},", ",{"type":45,"tag":115,"props":310,"children":312},{"className":311},[],[313],{"type":50,"value":314},"crdbcluster.yaml",{"type":50,"value":308},{"type":45,"tag":115,"props":317,"children":319},{"className":318},[],[320],{"type":50,"value":321},"events.txt",{"type":50,"value":308},{"type":45,"tag":115,"props":324,"children":326},{"className":325},[],[327],{"type":50,"value":328},"goroutine_dump.txt",{"type":50,"value":330},", and ",{"type":45,"tag":115,"props":332,"children":334},{"className":333},[],[335],{"type":50,"value":336},"metrics_dump.txt",{"type":50,"value":140},{"type":45,"tag":59,"props":339,"children":341},{"id":340},"step-1-context-and-version-inventory",[342],{"type":50,"value":343},"Step 1: Context and Version Inventory",{"type":45,"tag":263,"props":345,"children":347},{"className":265,"code":346,"language":267,"meta":268,"style":268},"kubectl config current-context > crdb-operator-escalation\u002Fkube-context.txt\nkubectl version --short > crdb-operator-escalation\u002Fkubernetes-version.txt\n\nhelm -n \u003Coperator-namespace> status \u003Coperator-release> > crdb-operator-escalation\u002Foperator-helm-status.txt 2>&1 || true\nhelm -n \u003Coperator-namespace> history \u003Coperator-release> > crdb-operator-escalation\u002Foperator-helm-history.txt 2>&1 || true\nhelm -n \u003Ccockroachdb-namespace> status \u003Ccockroachdb-release> > crdb-operator-escalation\u002Fcrdb-helm-status.txt 2>&1 || true\nhelm -n \u003Ccockroachdb-namespace> history \u003Ccockroachdb-release> > crdb-operator-escalation\u002Fcrdb-helm-history.txt 2>&1 || true\n\nkubectl -n \u003Coperator-namespace> get deploy cockroach-operator -o jsonpath='{.spec.template.spec.containers[0].image}{\"\\n\"}' > crdb-operator-escalation\u002Foperator-image.txt\nkubectl get crd crdbclusters.crdb.cockroachlabs.com crdbnodes.crdb.cockroachlabs.com -o wide > crdb-operator-escalation\u002Fcrds.txt\nkubectl get crd crdbclusters.crdb.cockroachlabs.com -o yaml > crdb-operator-escalation\u002Fcrdbclusters-crd.yaml\nkubectl get crd crdbnodes.crdb.cockroachlabs.com -o yaml > crdb-operator-escalation\u002Fcrdbnodes-crd.yaml\n",[348],{"type":45,"tag":115,"props":349,"children":350},{"__ignoreMap":268},[351,380,407,417,499,569,640,709,717,793,838,876],{"type":45,"tag":274,"props":352,"children":353},{"class":276,"line":277},[354,359,364,369,375],{"type":45,"tag":274,"props":355,"children":356},{"style":281},[357],{"type":50,"value":358},"kubectl",{"type":45,"tag":274,"props":360,"children":361},{"style":287},[362],{"type":50,"value":363}," config",{"type":45,"tag":274,"props":365,"children":366},{"style":287},[367],{"type":50,"value":368}," current-context",{"type":45,"tag":274,"props":370,"children":372},{"style":371},"--shiki-light:#39ADB5;--shiki-default:#89DDFF;--shiki-dark:#89DDFF",[373],{"type":50,"value":374}," >",{"type":45,"tag":274,"props":376,"children":377},{"style":287},[378],{"type":50,"value":379}," crdb-operator-escalation\u002Fkube-context.txt\n",{"type":45,"tag":274,"props":381,"children":383},{"class":276,"line":382},2,[384,388,393,398,402],{"type":45,"tag":274,"props":385,"children":386},{"style":281},[387],{"type":50,"value":358},{"type":45,"tag":274,"props":389,"children":390},{"style":287},[391],{"type":50,"value":392}," version",{"type":45,"tag":274,"props":394,"children":395},{"style":287},[396],{"type":50,"value":397}," --short",{"type":45,"tag":274,"props":399,"children":400},{"style":371},[401],{"type":50,"value":374},{"type":45,"tag":274,"props":403,"children":404},{"style":287},[405],{"type":50,"value":406}," crdb-operator-escalation\u002Fkubernetes-version.txt\n",{"type":45,"tag":274,"props":408,"children":410},{"class":276,"line":409},3,[411],{"type":45,"tag":274,"props":412,"children":414},{"emptyLinePlaceholder":413},true,[415],{"type":50,"value":416},"\n",{"type":45,"tag":274,"props":418,"children":420},{"class":276,"line":419},4,[421,426,431,436,441,447,452,457,461,466,470,474,478,483,488,493],{"type":45,"tag":274,"props":422,"children":423},{"style":281},[424],{"type":50,"value":425},"helm",{"type":45,"tag":274,"props":427,"children":428},{"style":287},[429],{"type":50,"value":430}," -n",{"type":45,"tag":274,"props":432,"children":433},{"style":371},[434],{"type":50,"value":435}," \u003C",{"type":45,"tag":274,"props":437,"children":438},{"style":287},[439],{"type":50,"value":440},"operator-namespac",{"type":45,"tag":274,"props":442,"children":444},{"style":443},"--shiki-light:#90A4AE;--shiki-default:#EEFFFF;--shiki-dark:#BABED8",[445],{"type":50,"value":446},"e",{"type":45,"tag":274,"props":448,"children":449},{"style":371},[450],{"type":50,"value":451},">",{"type":45,"tag":274,"props":453,"children":454},{"style":287},[455],{"type":50,"value":456}," status",{"type":45,"tag":274,"props":458,"children":459},{"style":371},[460],{"type":50,"value":435},{"type":45,"tag":274,"props":462,"children":463},{"style":287},[464],{"type":50,"value":465},"operator-releas",{"type":45,"tag":274,"props":467,"children":468},{"style":443},[469],{"type":50,"value":446},{"type":45,"tag":274,"props":471,"children":472},{"style":371},[473],{"type":50,"value":451},{"type":45,"tag":274,"props":475,"children":476},{"style":371},[477],{"type":50,"value":374},{"type":45,"tag":274,"props":479,"children":480},{"style":287},[481],{"type":50,"value":482}," crdb-operator-escalation\u002Foperator-helm-status.txt",{"type":45,"tag":274,"props":484,"children":485},{"style":371},[486],{"type":50,"value":487}," 2>&1",{"type":45,"tag":274,"props":489,"children":490},{"style":371},[491],{"type":50,"value":492}," ||",{"type":45,"tag":274,"props":494,"children":496},{"style":495},"--shiki-light:#6182B8;--shiki-default:#82AAFF;--shiki-dark:#82AAFF",[497],{"type":50,"value":498}," true\n",{"type":45,"tag":274,"props":500,"children":502},{"class":276,"line":501},5,[503,507,511,515,519,523,527,532,536,540,544,548,552,557,561,565],{"type":45,"tag":274,"props":504,"children":505},{"style":281},[506],{"type":50,"value":425},{"type":45,"tag":274,"props":508,"children":509},{"style":287},[510],{"type":50,"value":430},{"type":45,"tag":274,"props":512,"children":513},{"style":371},[514],{"type":50,"value":435},{"type":45,"tag":274,"props":516,"children":517},{"style":287},[518],{"type":50,"value":440},{"type":45,"tag":274,"props":520,"children":521},{"style":443},[522],{"type":50,"value":446},{"type":45,"tag":274,"props":524,"children":525},{"style":371},[526],{"type":50,"value":451},{"type":45,"tag":274,"props":528,"children":529},{"style":287},[530],{"type":50,"value":531}," history",{"type":45,"tag":274,"props":533,"children":534},{"style":371},[535],{"type":50,"value":435},{"type":45,"tag":274,"props":537,"children":538},{"style":287},[539],{"type":50,"value":465},{"type":45,"tag":274,"props":541,"children":542},{"style":443},[543],{"type":50,"value":446},{"type":45,"tag":274,"props":545,"children":546},{"style":371},[547],{"type":50,"value":451},{"type":45,"tag":274,"props":549,"children":550},{"style":371},[551],{"type":50,"value":374},{"type":45,"tag":274,"props":553,"children":554},{"style":287},[555],{"type":50,"value":556}," crdb-operator-escalation\u002Foperator-helm-history.txt",{"type":45,"tag":274,"props":558,"children":559},{"style":371},[560],{"type":50,"value":487},{"type":45,"tag":274,"props":562,"children":563},{"style":371},[564],{"type":50,"value":492},{"type":45,"tag":274,"props":566,"children":567},{"style":495},[568],{"type":50,"value":498},{"type":45,"tag":274,"props":570,"children":572},{"class":276,"line":571},6,[573,577,581,585,590,594,598,602,606,611,615,619,623,628,632,636],{"type":45,"tag":274,"props":574,"children":575},{"style":281},[576],{"type":50,"value":425},{"type":45,"tag":274,"props":578,"children":579},{"style":287},[580],{"type":50,"value":430},{"type":45,"tag":274,"props":582,"children":583},{"style":371},[584],{"type":50,"value":435},{"type":45,"tag":274,"props":586,"children":587},{"style":287},[588],{"type":50,"value":589},"cockroachdb-namespac",{"type":45,"tag":274,"props":591,"children":592},{"style":443},[593],{"type":50,"value":446},{"type":45,"tag":274,"props":595,"children":596},{"style":371},[597],{"type":50,"value":451},{"type":45,"tag":274,"props":599,"children":600},{"style":287},[601],{"type":50,"value":456},{"type":45,"tag":274,"props":603,"children":604},{"style":371},[605],{"type":50,"value":435},{"type":45,"tag":274,"props":607,"children":608},{"style":287},[609],{"type":50,"value":610},"cockroachdb-releas",{"type":45,"tag":274,"props":612,"children":613},{"style":443},[614],{"type":50,"value":446},{"type":45,"tag":274,"props":616,"children":617},{"style":371},[618],{"type":50,"value":451},{"type":45,"tag":274,"props":620,"children":621},{"style":371},[622],{"type":50,"value":374},{"type":45,"tag":274,"props":624,"children":625},{"style":287},[626],{"type":50,"value":627}," crdb-operator-escalation\u002Fcrdb-helm-status.txt",{"type":45,"tag":274,"props":629,"children":630},{"style":371},[631],{"type":50,"value":487},{"type":45,"tag":274,"props":633,"children":634},{"style":371},[635],{"type":50,"value":492},{"type":45,"tag":274,"props":637,"children":638},{"style":495},[639],{"type":50,"value":498},{"type":45,"tag":274,"props":641,"children":643},{"class":276,"line":642},7,[644,648,652,656,660,664,668,672,676,680,684,688,692,697,701,705],{"type":45,"tag":274,"props":645,"children":646},{"style":281},[647],{"type":50,"value":425},{"type":45,"tag":274,"props":649,"children":650},{"style":287},[651],{"type":50,"value":430},{"type":45,"tag":274,"props":653,"children":654},{"style":371},[655],{"type":50,"value":435},{"type":45,"tag":274,"props":657,"children":658},{"style":287},[659],{"type":50,"value":589},{"type":45,"tag":274,"props":661,"children":662},{"style":443},[663],{"type":50,"value":446},{"type":45,"tag":274,"props":665,"children":666},{"style":371},[667],{"type":50,"value":451},{"type":45,"tag":274,"props":669,"children":670},{"style":287},[671],{"type":50,"value":531},{"type":45,"tag":274,"props":673,"children":674},{"style":371},[675],{"type":50,"value":435},{"type":45,"tag":274,"props":677,"children":678},{"style":287},[679],{"type":50,"value":610},{"type":45,"tag":274,"props":681,"children":682},{"style":443},[683],{"type":50,"value":446},{"type":45,"tag":274,"props":685,"children":686},{"style":371},[687],{"type":50,"value":451},{"type":45,"tag":274,"props":689,"children":690},{"style":371},[691],{"type":50,"value":374},{"type":45,"tag":274,"props":693,"children":694},{"style":287},[695],{"type":50,"value":696}," crdb-operator-escalation\u002Fcrdb-helm-history.txt",{"type":45,"tag":274,"props":698,"children":699},{"style":371},[700],{"type":50,"value":487},{"type":45,"tag":274,"props":702,"children":703},{"style":371},[704],{"type":50,"value":492},{"type":45,"tag":274,"props":706,"children":707},{"style":495},[708],{"type":50,"value":498},{"type":45,"tag":274,"props":710,"children":712},{"class":276,"line":711},8,[713],{"type":45,"tag":274,"props":714,"children":715},{"emptyLinePlaceholder":413},[716],{"type":50,"value":416},{"type":45,"tag":274,"props":718,"children":720},{"class":276,"line":719},9,[721,725,729,733,737,741,745,750,755,760,765,770,775,780,784,788],{"type":45,"tag":274,"props":722,"children":723},{"style":281},[724],{"type":50,"value":358},{"type":45,"tag":274,"props":726,"children":727},{"style":287},[728],{"type":50,"value":430},{"type":45,"tag":274,"props":730,"children":731},{"style":371},[732],{"type":50,"value":435},{"type":45,"tag":274,"props":734,"children":735},{"style":287},[736],{"type":50,"value":440},{"type":45,"tag":274,"props":738,"children":739},{"style":443},[740],{"type":50,"value":446},{"type":45,"tag":274,"props":742,"children":743},{"style":371},[744],{"type":50,"value":451},{"type":45,"tag":274,"props":746,"children":747},{"style":287},[748],{"type":50,"value":749}," get",{"type":45,"tag":274,"props":751,"children":752},{"style":287},[753],{"type":50,"value":754}," deploy",{"type":45,"tag":274,"props":756,"children":757},{"style":287},[758],{"type":50,"value":759}," cockroach-operator",{"type":45,"tag":274,"props":761,"children":762},{"style":287},[763],{"type":50,"value":764}," -o",{"type":45,"tag":274,"props":766,"children":767},{"style":287},[768],{"type":50,"value":769}," jsonpath=",{"type":45,"tag":274,"props":771,"children":772},{"style":371},[773],{"type":50,"value":774},"'",{"type":45,"tag":274,"props":776,"children":777},{"style":287},[778],{"type":50,"value":779},"{.spec.template.spec.containers[0].image}{\"\\n\"}",{"type":45,"tag":274,"props":781,"children":782},{"style":371},[783],{"type":50,"value":774},{"type":45,"tag":274,"props":785,"children":786},{"style":371},[787],{"type":50,"value":374},{"type":45,"tag":274,"props":789,"children":790},{"style":287},[791],{"type":50,"value":792}," crdb-operator-escalation\u002Foperator-image.txt\n",{"type":45,"tag":274,"props":794,"children":796},{"class":276,"line":795},10,[797,801,805,810,815,820,824,829,833],{"type":45,"tag":274,"props":798,"children":799},{"style":281},[800],{"type":50,"value":358},{"type":45,"tag":274,"props":802,"children":803},{"style":287},[804],{"type":50,"value":749},{"type":45,"tag":274,"props":806,"children":807},{"style":287},[808],{"type":50,"value":809}," crd",{"type":45,"tag":274,"props":811,"children":812},{"style":287},[813],{"type":50,"value":814}," crdbclusters.crdb.cockroachlabs.com",{"type":45,"tag":274,"props":816,"children":817},{"style":287},[818],{"type":50,"value":819}," crdbnodes.crdb.cockroachlabs.com",{"type":45,"tag":274,"props":821,"children":822},{"style":287},[823],{"type":50,"value":764},{"type":45,"tag":274,"props":825,"children":826},{"style":287},[827],{"type":50,"value":828}," wide",{"type":45,"tag":274,"props":830,"children":831},{"style":371},[832],{"type":50,"value":374},{"type":45,"tag":274,"props":834,"children":835},{"style":287},[836],{"type":50,"value":837}," crdb-operator-escalation\u002Fcrds.txt\n",{"type":45,"tag":274,"props":839,"children":841},{"class":276,"line":840},11,[842,846,850,854,858,862,867,871],{"type":45,"tag":274,"props":843,"children":844},{"style":281},[845],{"type":50,"value":358},{"type":45,"tag":274,"props":847,"children":848},{"style":287},[849],{"type":50,"value":749},{"type":45,"tag":274,"props":851,"children":852},{"style":287},[853],{"type":50,"value":809},{"type":45,"tag":274,"props":855,"children":856},{"style":287},[857],{"type":50,"value":814},{"type":45,"tag":274,"props":859,"children":860},{"style":287},[861],{"type":50,"value":764},{"type":45,"tag":274,"props":863,"children":864},{"style":287},[865],{"type":50,"value":866}," yaml",{"type":45,"tag":274,"props":868,"children":869},{"style":371},[870],{"type":50,"value":374},{"type":45,"tag":274,"props":872,"children":873},{"style":287},[874],{"type":50,"value":875}," crdb-operator-escalation\u002Fcrdbclusters-crd.yaml\n",{"type":45,"tag":274,"props":877,"children":879},{"class":276,"line":878},12,[880,884,888,892,896,900,904,908],{"type":45,"tag":274,"props":881,"children":882},{"style":281},[883],{"type":50,"value":358},{"type":45,"tag":274,"props":885,"children":886},{"style":287},[887],{"type":50,"value":749},{"type":45,"tag":274,"props":889,"children":890},{"style":287},[891],{"type":50,"value":809},{"type":45,"tag":274,"props":893,"children":894},{"style":287},[895],{"type":50,"value":819},{"type":45,"tag":274,"props":897,"children":898},{"style":287},[899],{"type":50,"value":764},{"type":45,"tag":274,"props":901,"children":902},{"style":287},[903],{"type":50,"value":866},{"type":45,"tag":274,"props":905,"children":906},{"style":371},[907],{"type":50,"value":374},{"type":45,"tag":274,"props":909,"children":910},{"style":287},[911],{"type":50,"value":912}," crdb-operator-escalation\u002Fcrdbnodes-crd.yaml\n",{"type":45,"tag":53,"props":914,"children":915},{},[916],{"type":50,"value":917},"Get the CockroachDB version from a Ready pod:",{"type":45,"tag":263,"props":919,"children":921},{"className":265,"code":920,"language":267,"meta":268,"style":268},"kubectl -n \u003Ccockroachdb-namespace> exec \u003Cready-crdb-pod> -c cockroachdb -- \\\n \u002Fcockroach\u002Fcockroach version > crdb-operator-escalation\u002Fcrdb-version.txt 2>&1\n",[922],{"type":45,"tag":115,"props":923,"children":924},{"__ignoreMap":268},[925,995],{"type":45,"tag":274,"props":926,"children":927},{"class":276,"line":277},[928,932,936,940,944,948,952,957,961,966,971,975,980,985,990],{"type":45,"tag":274,"props":929,"children":930},{"style":281},[931],{"type":50,"value":358},{"type":45,"tag":274,"props":933,"children":934},{"style":287},[935],{"type":50,"value":430},{"type":45,"tag":274,"props":937,"children":938},{"style":371},[939],{"type":50,"value":435},{"type":45,"tag":274,"props":941,"children":942},{"style":287},[943],{"type":50,"value":589},{"type":45,"tag":274,"props":945,"children":946},{"style":443},[947],{"type":50,"value":446},{"type":45,"tag":274,"props":949,"children":950},{"style":371},[951],{"type":50,"value":451},{"type":45,"tag":274,"props":953,"children":954},{"style":287},[955],{"type":50,"value":956}," exec",{"type":45,"tag":274,"props":958,"children":959},{"style":371},[960],{"type":50,"value":435},{"type":45,"tag":274,"props":962,"children":963},{"style":287},[964],{"type":50,"value":965},"ready-crdb-po",{"type":45,"tag":274,"props":967,"children":968},{"style":443},[969],{"type":50,"value":970},"d",{"type":45,"tag":274,"props":972,"children":973},{"style":371},[974],{"type":50,"value":451},{"type":45,"tag":274,"props":976,"children":977},{"style":287},[978],{"type":50,"value":979}," -c",{"type":45,"tag":274,"props":981,"children":982},{"style":287},[983],{"type":50,"value":984}," cockroachdb",{"type":45,"tag":274,"props":986,"children":987},{"style":287},[988],{"type":50,"value":989}," --",{"type":45,"tag":274,"props":991,"children":992},{"style":443},[993],{"type":50,"value":994}," \\\n",{"type":45,"tag":274,"props":996,"children":997},{"class":276,"line":382},[998,1003,1007,1011,1016],{"type":45,"tag":274,"props":999,"children":1000},{"style":287},[1001],{"type":50,"value":1002}," \u002Fcockroach\u002Fcockroach",{"type":45,"tag":274,"props":1004,"children":1005},{"style":287},[1006],{"type":50,"value":392},{"type":45,"tag":274,"props":1008,"children":1009},{"style":371},[1010],{"type":50,"value":374},{"type":45,"tag":274,"props":1012,"children":1013},{"style":287},[1014],{"type":50,"value":1015}," crdb-operator-escalation\u002Fcrdb-version.txt",{"type":45,"tag":274,"props":1017,"children":1018},{"style":371},[1019],{"type":50,"value":1020}," 2>&1\n",{"type":45,"tag":59,"props":1022,"children":1024},{"id":1023},"step-2-resource-specifications-and-status",[1025],{"type":50,"value":1026},"Step 2: Resource Specifications and Status",{"type":45,"tag":263,"props":1028,"children":1030},{"className":265,"code":1029,"language":267,"meta":268,"style":268},"kubectl -n \u003Coperator-namespace> get deploy,pod,svc,endpoints -o wide > crdb-operator-escalation\u002Foperator-resources.txt\nkubectl -n \u003Coperator-namespace> describe deploy cockroach-operator > crdb-operator-escalation\u002Foperator-deploy-describe.txt\nkubectl -n \u003Coperator-namespace> describe pods -l app=cockroach-operator > crdb-operator-escalation\u002Foperator-pods-describe.txt\nkubectl -n \u003Coperator-namespace> get deploy cockroach-operator -o yaml > crdb-operator-escalation\u002Foperator-deploy.yaml\n\nkubectl -n \u003Ccockroachdb-namespace> get crdbcluster \u003Ccockroachdb-release> -o yaml > crdb-operator-escalation\u002Fcrdbcluster.yaml\nkubectl -n \u003Ccockroachdb-namespace> describe crdbcluster \u003Ccockroachdb-release> > crdb-operator-escalation\u002Fcrdbcluster-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> get crdbnodes -o yaml > crdb-operator-escalation\u002Fcrdbnodes.yaml\nkubectl -n \u003Ccockroachdb-namespace> describe crdbnodes > crdb-operator-escalation\u002Fcrdbnodes-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> get pod,svc,endpoints,pvc,pdb -o wide > crdb-operator-escalation\u002Fcrdb-resources-wide.txt\nkubectl -n \u003Ccockroachdb-namespace> describe pods -l app.kubernetes.io\u002Fname=cockroachdb > crdb-operator-escalation\u002Fcrdb-pods-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> describe pvc > crdb-operator-escalation\u002Fpvc-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> describe pdb > crdb-operator-escalation\u002Fpdb-describe.txt\nkubectl -n \u003Ccockroachdb-namespace> get events --sort-by=.lastTimestamp > crdb-operator-escalation\u002Fevents.txt\n",[1031],{"type":45,"tag":115,"props":1032,"children":1033},{"__ignoreMap":268},[1034,1087,1136,1191,1247,1254,1323,1383,1436,1480,1533,1586,1631,1677],{"type":45,"tag":274,"props":1035,"children":1036},{"class":276,"line":277},[1037,1041,1045,1049,1053,1057,1061,1065,1070,1074,1078,1082],{"type":45,"tag":274,"props":1038,"children":1039},{"style":281},[1040],{"type":50,"value":358},{"type":45,"tag":274,"props":1042,"children":1043},{"style":287},[1044],{"type":50,"value":430},{"type":45,"tag":274,"props":1046,"children":1047},{"style":371},[1048],{"type":50,"value":435},{"type":45,"tag":274,"props":1050,"children":1051},{"style":287},[1052],{"type":50,"value":440},{"type":45,"tag":274,"props":1054,"children":1055},{"style":443},[1056],{"type":50,"value":446},{"type":45,"tag":274,"props":1058,"children":1059},{"style":371},[1060],{"type":50,"value":451},{"type":45,"tag":274,"props":1062,"children":1063},{"style":287},[1064],{"type":50,"value":749},{"type":45,"tag":274,"props":1066,"children":1067},{"style":287},[1068],{"type":50,"value":1069}," deploy,pod,svc,endpoints",{"type":45,"tag":274,"props":1071,"children":1072},{"style":287},[1073],{"type":50,"value":764},{"type":45,"tag":274,"props":1075,"children":1076},{"style":287},[1077],{"type":50,"value":828},{"type":45,"tag":274,"props":1079,"children":1080},{"style":371},[1081],{"type":50,"value":374},{"type":45,"tag":274,"props":1083,"children":1084},{"style":287},[1085],{"type":50,"value":1086}," crdb-operator-escalation\u002Foperator-resources.txt\n",{"type":45,"tag":274,"props":1088,"children":1089},{"class":276,"line":382},[1090,1094,1098,1102,1106,1110,1114,1119,1123,1127,1131],{"type":45,"tag":274,"props":1091,"children":1092},{"style":281},[1093],{"type":50,"value":358},{"type":45,"tag":274,"props":1095,"children":1096},{"style":287},[1097],{"type":50,"value":430},{"type":45,"tag":274,"props":1099,"children":1100},{"style":371},[1101],{"type":50,"value":435},{"type":45,"tag":274,"props":1103,"children":1104},{"style":287},[1105],{"type":50,"value":440},{"type":45,"tag":274,"props":1107,"children":1108},{"style":443},[1109],{"type":50,"value":446},{"type":45,"tag":274,"props":1111,"children":1112},{"style":371},[1113],{"type":50,"value":451},{"type":45,"tag":274,"props":1115,"children":1116},{"style":287},[1117],{"type":50,"value":1118}," describe",{"type":45,"tag":274,"props":1120,"children":1121},{"style":287},[1122],{"type":50,"value":754},{"type":45,"tag":274,"props":1124,"children":1125},{"style":287},[1126],{"type":50,"value":759},{"type":45,"tag":274,"props":1128,"children":1129},{"style":371},[1130],{"type":50,"value":374},{"type":45,"tag":274,"props":1132,"children":1133},{"style":287},[1134],{"type":50,"value":1135}," crdb-operator-escalation\u002Foperator-deploy-describe.txt\n",{"type":45,"tag":274,"props":1137,"children":1138},{"class":276,"line":409},[1139,1143,1147,1151,1155,1159,1163,1167,1172,1177,1182,1186],{"type":45,"tag":274,"props":1140,"children":1141},{"style":281},[1142],{"type":50,"value":358},{"type":45,"tag":274,"props":1144,"children":1145},{"style":287},[1146],{"type":50,"value":430},{"type":45,"tag":274,"props":1148,"children":1149},{"style":371},[1150],{"type":50,"value":435},{"type":45,"tag":274,"props":1152,"children":1153},{"style":287},[1154],{"type":50,"value":440},{"type":45,"tag":274,"props":1156,"children":1157},{"style":443},[1158],{"type":50,"value":446},{"type":45,"tag":274,"props":1160,"children":1161},{"style":371},[1162],{"type":50,"value":451},{"type":45,"tag":274,"props":1164,"children":1165},{"style":287},[1166],{"type":50,"value":1118},{"type":45,"tag":274,"props":1168,"children":1169},{"style":287},[1170],{"type":50,"value":1171}," pods",{"type":45,"tag":274,"props":1173,"children":1174},{"style":287},[1175],{"type":50,"value":1176}," -l",{"type":45,"tag":274,"props":1178,"children":1179},{"style":287},[1180],{"type":50,"value":1181}," app=cockroach-operator",{"type":45,"tag":274,"props":1183,"children":1184},{"style":371},[1185],{"type":50,"value":374},{"type":45,"tag":274,"props":1187,"children":1188},{"style":287},[1189],{"type":50,"value":1190}," crdb-operator-escalation\u002Foperator-pods-describe.txt\n",{"type":45,"tag":274,"props":1192,"children":1193},{"class":276,"line":419},[1194,1198,1202,1206,1210,1214,1218,1222,1226,1230,1234,1238,1242],{"type":45,"tag":274,"props":1195,"children":1196},{"style":281},[1197],{"type":50,"value":358},{"type":45,"tag":274,"props":1199,"children":1200},{"style":287},[1201],{"type":50,"value":430},{"type":45,"tag":274,"props":1203,"children":1204},{"style":371},[1205],{"type":50,"value":435},{"type":45,"tag":274,"props":1207,"children":1208},{"style":287},[1209],{"type":50,"value":440},{"type":45,"tag":274,"props":1211,"children":1212},{"style":443},[1213],{"type":50,"value":446},{"type":45,"tag":274,"props":1215,"children":1216},{"style":371},[1217],{"type":50,"value":451},{"type":45,"tag":274,"props":1219,"children":1220},{"style":287},[1221],{"type":50,"value":749},{"type":45,"tag":274,"props":1223,"children":1224},{"style":287},[1225],{"type":50,"value":754},{"type":45,"tag":274,"props":1227,"children":1228},{"style":287},[1229],{"type":50,"value":759},{"type":45,"tag":274,"props":1231,"children":1232},{"style":287},[1233],{"type":50,"value":764},{"type":45,"tag":274,"props":1235,"children":1236},{"style":287},[1237],{"type":50,"value":866},{"type":45,"tag":274,"props":1239,"children":1240},{"style":371},[1241],{"type":50,"value":374},{"type":45,"tag":274,"props":1243,"children":1244},{"style":287},[1245],{"type":50,"value":1246}," crdb-operator-escalation\u002Foperator-deploy.yaml\n",{"type":45,"tag":274,"props":1248,"children":1249},{"class":276,"line":501},[1250],{"type":45,"tag":274,"props":1251,"children":1252},{"emptyLinePlaceholder":413},[1253],{"type":50,"value":416},{"type":45,"tag":274,"props":1255,"children":1256},{"class":276,"line":571},[1257,1261,1265,1269,1273,1277,1281,1285,1290,1294,1298,1302,1306,1310,1314,1318],{"type":45,"tag":274,"props":1258,"children":1259},{"style":281},[1260],{"type":50,"value":358},{"type":45,"tag":274,"props":1262,"children":1263},{"style":287},[1264],{"type":50,"value":430},{"type":45,"tag":274,"props":1266,"children":1267},{"style":371},[1268],{"type":50,"value":435},{"type":45,"tag":274,"props":1270,"children":1271},{"style":287},[1272],{"type":50,"value":589},{"type":45,"tag":274,"props":1274,"children":1275},{"style":443},[1276],{"type":50,"value":446},{"type":45,"tag":274,"props":1278,"children":1279},{"style":371},[1280],{"type":50,"value":451},{"type":45,"tag":274,"props":1282,"children":1283},{"style":287},[1284],{"type":50,"value":749},{"type":45,"tag":274,"props":1286,"children":1287},{"style":287},[1288],{"type":50,"value":1289}," crdbcluster",{"type":45,"tag":274,"props":1291,"children":1292},{"style":371},[1293],{"type":50,"value":435},{"type":45,"tag":274,"props":1295,"children":1296},{"style":287},[1297],{"type":50,"value":610},{"type":45,"tag":274,"props":1299,"children":1300},{"style":443},[1301],{"type":50,"value":446},{"type":45,"tag":274,"props":1303,"children":1304},{"style":371},[1305],{"type":50,"value":451},{"type":45,"tag":274,"props":1307,"children":1308},{"style":287},[1309],{"type":50,"value":764},{"type":45,"tag":274,"props":1311,"children":1312},{"style":287},[1313],{"type":50,"value":866},{"type":45,"tag":274,"props":1315,"children":1316},{"style":371},[1317],{"type":50,"value":374},{"type":45,"tag":274,"props":1319,"children":1320},{"style":287},[1321],{"type":50,"value":1322}," crdb-operator-escalation\u002Fcrdbcluster.yaml\n",{"type":45,"tag":274,"props":1324,"children":1325},{"class":276,"line":642},[1326,1330,1334,1338,1342,1346,1350,1354,1358,1362,1366,1370,1374,1378],{"type":45,"tag":274,"props":1327,"children":1328},{"style":281},[1329],{"type":50,"value":358},{"type":45,"tag":274,"props":1331,"children":1332},{"style":287},[1333],{"type":50,"value":430},{"type":45,"tag":274,"props":1335,"children":1336},{"style":371},[1337],{"type":50,"value":435},{"type":45,"tag":274,"props":1339,"children":1340},{"style":287},[1341],{"type":50,"value":589},{"type":45,"tag":274,"props":1343,"children":1344},{"style":443},[1345],{"type":50,"value":446},{"type":45,"tag":274,"props":1347,"children":1348},{"style":371},[1349],{"type":50,"value":451},{"type":45,"tag":274,"props":1351,"children":1352},{"style":287},[1353],{"type":50,"value":1118},{"type":45,"tag":274,"props":1355,"children":1356},{"style":287},[1357],{"type":50,"value":1289},{"type":45,"tag":274,"props":1359,"children":1360},{"style":371},[1361],{"type":50,"value":435},{"type":45,"tag":274,"props":1363,"children":1364},{"style":287},[1365],{"type":50,"value":610},{"type":45,"tag":274,"props":1367,"children":1368},{"style":443},[1369],{"type":50,"value":446},{"type":45,"tag":274,"props":1371,"children":1372},{"style":371},[1373],{"type":50,"value":451},{"type":45,"tag":274,"props":1375,"children":1376},{"style":371},[1377],{"type":50,"value":374},{"type":45,"tag":274,"props":1379,"children":1380},{"style":287},[1381],{"type":50,"value":1382}," crdb-operator-escalation\u002Fcrdbcluster-describe.txt\n",{"type":45,"tag":274,"props":1384,"children":1385},{"class":276,"line":711},[1386,1390,1394,1398,1402,1406,1410,1414,1419,1423,1427,1431],{"type":45,"tag":274,"props":1387,"children":1388},{"style":281},[1389],{"type":50,"value":358},{"type":45,"tag":274,"props":1391,"children":1392},{"style":287},[1393],{"type":50,"value":430},{"type":45,"tag":274,"props":1395,"children":1396},{"style":371},[1397],{"type":50,"value":435},{"type":45,"tag":274,"props":1399,"children":1400},{"style":287},[1401],{"type":50,"value":589},{"type":45,"tag":274,"props":1403,"children":1404},{"style":443},[1405],{"type":50,"value":446},{"type":45,"tag":274,"props":1407,"children":1408},{"style":371},[1409],{"type":50,"value":451},{"type":45,"tag":274,"props":1411,"children":1412},{"style":287},[1413],{"type":50,"value":749},{"type":45,"tag":274,"props":1415,"children":1416},{"style":287},[1417],{"type":50,"value":1418}," crdbnodes",{"type":45,"tag":274,"props":1420,"children":1421},{"style":287},[1422],{"type":50,"value":764},{"type":45,"tag":274,"props":1424,"children":1425},{"style":287},[1426],{"type":50,"value":866},{"type":45,"tag":274,"props":1428,"children":1429},{"style":371},[1430],{"type":50,"value":374},{"type":45,"tag":274,"props":1432,"children":1433},{"style":287},[1434],{"type":50,"value":1435}," crdb-operator-escalation\u002Fcrdbnodes.yaml\n",{"type":45,"tag":274,"props":1437,"children":1438},{"class":276,"line":719},[1439,1443,1447,1451,1455,1459,1463,1467,1471,1475],{"type":45,"tag":274,"props":1440,"children":1441},{"style":281},[1442],{"type":50,"value":358},{"type":45,"tag":274,"props":1444,"children":1445},{"style":287},[1446],{"type":50,"value":430},{"type":45,"tag":274,"props":1448,"children":1449},{"style":371},[1450],{"type":50,"value":435},{"type":45,"tag":274,"props":1452,"children":1453},{"style":287},[1454],{"type":50,"value":589},{"type":45,"tag":274,"props":1456,"children":1457},{"style":443},[1458],{"type":50,"value":446},{"type":45,"tag":274,"props":1460,"children":1461},{"style":371},[1462],{"type":50,"value":451},{"type":45,"tag":274,"props":1464,"children":1465},{"style":287},[1466],{"type":50,"value":1118},{"type":45,"tag":274,"props":1468,"children":1469},{"style":287},[1470],{"type":50,"value":1418},{"type":45,"tag":274,"props":1472,"children":1473},{"style":371},[1474],{"type":50,"value":374},{"type":45,"tag":274,"props":1476,"children":1477},{"style":287},[1478],{"type":50,"value":1479}," crdb-operator-escalation\u002Fcrdbnodes-describe.txt\n",{"type":45,"tag":274,"props":1481,"children":1482},{"class":276,"line":795},[1483,1487,1491,1495,1499,1503,1507,1511,1516,1520,1524,1528],{"type":45,"tag":274,"props":1484,"children":1485},{"style":281},[1486],{"type":50,"value":358},{"type":45,"tag":274,"props":1488,"children":1489},{"style":287},[1490],{"type":50,"value":430},{"type":45,"tag":274,"props":1492,"children":1493},{"style":371},[1494],{"type":50,"value":435},{"type":45,"tag":274,"props":1496,"children":1497},{"style":287},[1498],{"type":50,"value":589},{"type":45,"tag":274,"props":1500,"children":1501},{"style":443},[1502],{"type":50,"value":446},{"type":45,"tag":274,"props":1504,"children":1505},{"style":371},[1506],{"type":50,"value":451},{"type":45,"tag":274,"props":1508,"children":1509},{"style":287},[1510],{"type":50,"value":749},{"type":45,"tag":274,"props":1512,"children":1513},{"style":287},[1514],{"type":50,"value":1515}," pod,svc,endpoints,pvc,pdb",{"type":45,"tag":274,"props":1517,"children":1518},{"style":287},[1519],{"type":50,"value":764},{"type":45,"tag":274,"props":1521,"children":1522},{"style":287},[1523],{"type":50,"value":828},{"type":45,"tag":274,"props":1525,"children":1526},{"style":371},[1527],{"type":50,"value":374},{"type":45,"tag":274,"props":1529,"children":1530},{"style":287},[1531],{"type":50,"value":1532}," crdb-operator-escalation\u002Fcrdb-resources-wide.txt\n",{"type":45,"tag":274,"props":1534,"children":1535},{"class":276,"line":840},[1536,1540,1544,1548,1552,1556,1560,1564,1568,1572,1577,1581],{"type":45,"tag":274,"props":1537,"children":1538},{"style":281},[1539],{"type":50,"value":358},{"type":45,"tag":274,"props":1541,"children":1542},{"style":287},[1543],{"type":50,"value":430},{"type":45,"tag":274,"props":1545,"children":1546},{"style":371},[1547],{"type":50,"value":435},{"type":45,"tag":274,"props":1549,"children":1550},{"style":287},[1551],{"type":50,"value":589},{"type":45,"tag":274,"props":1553,"children":1554},{"style":443},[1555],{"type":50,"value":446},{"type":45,"tag":274,"props":1557,"children":1558},{"style":371},[1559],{"type":50,"value":451},{"type":45,"tag":274,"props":1561,"children":1562},{"style":287},[1563],{"type":50,"value":1118},{"type":45,"tag":274,"props":1565,"children":1566},{"style":287},[1567],{"type":50,"value":1171},{"type":45,"tag":274,"props":1569,"children":1570},{"style":287},[1571],{"type":50,"value":1176},{"type":45,"tag":274,"props":1573,"children":1574},{"style":287},[1575],{"type":50,"value":1576}," app.kubernetes.io\u002Fname=cockroachdb",{"type":45,"tag":274,"props":1578,"children":1579},{"style":371},[1580],{"type":50,"value":374},{"type":45,"tag":274,"props":1582,"children":1583},{"style":287},[1584],{"type":50,"value":1585}," crdb-operator-escalation\u002Fcrdb-pods-describe.txt\n",{"type":45,"tag":274,"props":1587,"children":1588},{"class":276,"line":878},[1589,1593,1597,1601,1605,1609,1613,1617,1622,1626],{"type":45,"tag":274,"props":1590,"children":1591},{"style":281},[1592],{"type":50,"value":358},{"type":45,"tag":274,"props":1594,"children":1595},{"style":287},[1596],{"type":50,"value":430},{"type":45,"tag":274,"props":1598,"children":1599},{"style":371},[1600],{"type":50,"value":435},{"type":45,"tag":274,"props":1602,"children":1603},{"style":287},[1604],{"type":50,"value":589},{"type":45,"tag":274,"props":1606,"children":1607},{"style":443},[1608],{"type":50,"value":446},{"type":45,"tag":274,"props":1610,"children":1611},{"style":371},[1612],{"type":50,"value":451},{"type":45,"tag":274,"props":1614,"children":1615},{"style":287},[1616],{"type":50,"value":1118},{"type":45,"tag":274,"props":1618,"children":1619},{"style":287},[1620],{"type":50,"value":1621}," pvc",{"type":45,"tag":274,"props":1623,"children":1624},{"style":371},[1625],{"type":50,"value":374},{"type":45,"tag":274,"props":1627,"children":1628},{"style":287},[1629],{"type":50,"value":1630}," crdb-operator-escalation\u002Fpvc-describe.txt\n",{"type":45,"tag":274,"props":1632,"children":1634},{"class":276,"line":1633},13,[1635,1639,1643,1647,1651,1655,1659,1663,1668,1672],{"type":45,"tag":274,"props":1636,"children":1637},{"style":281},[1638],{"type":50,"value":358},{"type":45,"tag":274,"props":1640,"children":1641},{"style":287},[1642],{"type":50,"value":430},{"type":45,"tag":274,"props":1644,"children":1645},{"style":371},[1646],{"type":50,"value":435},{"type":45,"tag":274,"props":1648,"children":1649},{"style":287},[1650],{"type":50,"value":589},{"type":45,"tag":274,"props":1652,"children":1653},{"style":443},[1654],{"type":50,"value":446},{"type":45,"tag":274,"props":1656,"children":1657},{"style":371},[1658],{"type":50,"value":451},{"type":45,"tag":274,"props":1660,"children":1661},{"style":287},[1662],{"type":50,"value":1118},{"type":45,"tag":274,"props":1664,"children":1665},{"style":287},[1666],{"type":50,"value":1667}," pdb",{"type":45,"tag":274,"props":1669,"children":1670},{"style":371},[1671],{"type":50,"value":374},{"type":45,"tag":274,"props":1673,"children":1674},{"style":287},[1675],{"type":50,"value":1676}," crdb-operator-escalation\u002Fpdb-describe.txt\n",{"type":45,"tag":274,"props":1678,"children":1680},{"class":276,"line":1679},14,[1681,1685,1689,1693,1697,1701,1705,1709,1714,1719,1723],{"type":45,"tag":274,"props":1682,"children":1683},{"style":281},[1684],{"type":50,"value":358},{"type":45,"tag":274,"props":1686,"children":1687},{"style":287},[1688],{"type":50,"value":430},{"type":45,"tag":274,"props":1690,"children":1691},{"style":371},[1692],{"type":50,"value":435},{"type":45,"tag":274,"props":1694,"children":1695},{"style":287},[1696],{"type":50,"value":589},{"type":45,"tag":274,"props":1698,"children":1699},{"style":443},[1700],{"type":50,"value":446},{"type":45,"tag":274,"props":1702,"children":1703},{"style":371},[1704],{"type":50,"value":451},{"type":45,"tag":274,"props":1706,"children":1707},{"style":287},[1708],{"type":50,"value":749},{"type":45,"tag":274,"props":1710,"children":1711},{"style":287},[1712],{"type":50,"value":1713}," events",{"type":45,"tag":274,"props":1715,"children":1716},{"style":287},[1717],{"type":50,"value":1718}," --sort-by=.lastTimestamp",{"type":45,"tag":274,"props":1720,"children":1721},{"style":371},[1722],{"type":50,"value":374},{"type":45,"tag":274,"props":1724,"children":1725},{"style":287},[1726],{"type":50,"value":1727}," crdb-operator-escalation\u002Fevents.txt\n",{"type":45,"tag":53,"props":1729,"children":1730},{},[1731],{"type":50,"value":1732},"Summarize key cluster status:",{"type":45,"tag":263,"props":1734,"children":1736},{"className":265,"code":1735,"language":267,"meta":268,"style":268},"kubectl -n \u003Ccockroachdb-namespace> get crdbcluster \u003Ccockroachdb-release> -o json | jq '{\n mode: .spec.mode,\n nodes: [.spec.regions[]?.nodes],\n regions: .spec.regions,\n image: .spec.image,\n generation: .metadata.generation,\n observedGeneration: .status.observedGeneration,\n statusImage: .status.image,\n actions: .status.actions,\n conditions: .status.conditions,\n labels: .metadata.labels,\n annotations: .metadata.annotations\n}' > crdb-operator-escalation\u002Fcrdbcluster-summary.json\n\nkubectl -n \u003Ccockroachdb-namespace> get crdbnodes \\\n -o custom-columns=NAME:.metadata.name,GENERATION:.metadata.generation,OBSERVED:.status.observedGeneration,PHASE:.status.phase,HASH:.metadata.annotations[\"crdb.cockroachlabs.com\u002Fhash-revision\"],NODE_ID:.status.nodeID \\\n > crdb-operator-escalation\u002Fcrdbnodes-summary.txt\n",[1737],{"type":45,"tag":115,"props":1738,"children":1739},{"__ignoreMap":268},[1740,1820,1828,1836,1844,1852,1860,1868,1876,1884,1892,1900,1908,1929,1936,1976,2013],{"type":45,"tag":274,"props":1741,"children":1742},{"class":276,"line":277},[1743,1747,1751,1755,1759,1763,1767,1771,1775,1779,1783,1787,1791,1795,1800,1805,1810,1815],{"type":45,"tag":274,"props":1744,"children":1745},{"style":281},[1746],{"type":50,"value":358},{"type":45,"tag":274,"props":1748,"children":1749},{"style":287},[1750],{"type":50,"value":430},{"type":45,"tag":274,"props":1752,"children":1753},{"style":371},[1754],{"type":50,"value":435},{"type":45,"tag":274,"props":1756,"children":1757},{"style":287},[1758],{"type":50,"value":589},{"type":45,"tag":274,"props":1760,"children":1761},{"style":443},[1762],{"type":50,"value":446},{"type":45,"tag":274,"props":1764,"children":1765},{"style":371},[1766],{"type":50,"value":451},{"type":45,"tag":274,"props":1768,"children":1769},{"style":287},[1770],{"type":50,"value":749},{"type":45,"tag":274,"props":1772,"children":1773},{"style":287},[1774],{"type":50,"value":1289},{"type":45,"tag":274,"props":1776,"children":1777},{"style":371},[1778],{"type":50,"value":435},{"type":45,"tag":274,"props":1780,"children":1781},{"style":287},[1782],{"type":50,"value":610},{"type":45,"tag":274,"props":1784,"children":1785},{"style":443},[1786],{"type":50,"value":446},{"type":45,"tag":274,"props":1788,"children":1789},{"style":371},[1790],{"type":50,"value":451},{"type":45,"tag":274,"props":1792,"children":1793},{"style":287},[1794],{"type":50,"value":764},{"type":45,"tag":274,"props":1796,"children":1797},{"style":287},[1798],{"type":50,"value":1799}," json",{"type":45,"tag":274,"props":1801,"children":1802},{"style":371},[1803],{"type":50,"value":1804}," |",{"type":45,"tag":274,"props":1806,"children":1807},{"style":281},[1808],{"type":50,"value":1809}," jq",{"type":45,"tag":274,"props":1811,"children":1812},{"style":371},[1813],{"type":50,"value":1814}," '",{"type":45,"tag":274,"props":1816,"children":1817},{"style":287},[1818],{"type":50,"value":1819},"{\n",{"type":45,"tag":274,"props":1821,"children":1822},{"class":276,"line":382},[1823],{"type":45,"tag":274,"props":1824,"children":1825},{"style":287},[1826],{"type":50,"value":1827}," mode: .spec.mode,\n",{"type":45,"tag":274,"props":1829,"children":1830},{"class":276,"line":409},[1831],{"type":45,"tag":274,"props":1832,"children":1833},{"style":287},[1834],{"type":50,"value":1835}," nodes: [.spec.regions[]?.nodes],\n",{"type":45,"tag":274,"props":1837,"children":1838},{"class":276,"line":419},[1839],{"type":45,"tag":274,"props":1840,"children":1841},{"style":287},[1842],{"type":50,"value":1843}," regions: .spec.regions,\n",{"type":45,"tag":274,"props":1845,"children":1846},{"class":276,"line":501},[1847],{"type":45,"tag":274,"props":1848,"children":1849},{"style":287},[1850],{"type":50,"value":1851}," image: .spec.image,\n",{"type":45,"tag":274,"props":1853,"children":1854},{"class":276,"line":571},[1855],{"type":45,"tag":274,"props":1856,"children":1857},{"style":287},[1858],{"type":50,"value":1859}," generation: .metadata.generation,\n",{"type":45,"tag":274,"props":1861,"children":1862},{"class":276,"line":642},[1863],{"type":45,"tag":274,"props":1864,"children":1865},{"style":287},[1866],{"type":50,"value":1867}," observedGeneration: .status.observedGeneration,\n",{"type":45,"tag":274,"props":1869,"children":1870},{"class":276,"line":711},[1871],{"type":45,"tag":274,"props":1872,"children":1873},{"style":287},[1874],{"type":50,"value":1875}," statusImage: .status.image,\n",{"type":45,"tag":274,"props":1877,"children":1878},{"class":276,"line":719},[1879],{"type":45,"tag":274,"props":1880,"children":1881},{"style":287},[1882],{"type":50,"value":1883}," actions: .status.actions,\n",{"type":45,"tag":274,"props":1885,"children":1886},{"class":276,"line":795},[1887],{"type":45,"tag":274,"props":1888,"children":1889},{"style":287},[1890],{"type":50,"value":1891}," conditions: .status.conditions,\n",{"type":45,"tag":274,"props":1893,"children":1894},{"class":276,"line":840},[1895],{"type":45,"tag":274,"props":1896,"children":1897},{"style":287},[1898],{"type":50,"value":1899}," labels: .metadata.labels,\n",{"type":45,"tag":274,"props":1901,"children":1902},{"class":276,"line":878},[1903],{"type":45,"tag":274,"props":1904,"children":1905},{"style":287},[1906],{"type":50,"value":1907}," annotations: .metadata.annotations\n",{"type":45,"tag":274,"props":1909,"children":1910},{"class":276,"line":1633},[1911,1916,1920,1924],{"type":45,"tag":274,"props":1912,"children":1913},{"style":287},[1914],{"type":50,"value":1915},"}",{"type":45,"tag":274,"props":1917,"children":1918},{"style":371},[1919],{"type":50,"value":774},{"type":45,"tag":274,"props":1921,"children":1922},{"style":371},[1923],{"type":50,"value":374},{"type":45,"tag":274,"props":1925,"children":1926},{"style":287},[1927],{"type":50,"value":1928}," crdb-operator-escalation\u002Fcrdbcluster-summary.json\n",{"type":45,"tag":274,"props":1930,"children":1931},{"class":276,"line":1679},[1932],{"type":45,"tag":274,"props":1933,"children":1934},{"emptyLinePlaceholder":413},[1935],{"type":50,"value":416},{"type":45,"tag":274,"props":1937,"children":1939},{"class":276,"line":1938},15,[1940,1944,1948,1952,1956,1960,1964,1968,1972],{"type":45,"tag":274,"props":1941,"children":1942},{"style":281},[1943],{"type":50,"value":358},{"type":45,"tag":274,"props":1945,"children":1946},{"style":287},[1947],{"type":50,"value":430},{"type":45,"tag":274,"props":1949,"children":1950},{"style":371},[1951],{"type":50,"value":435},{"type":45,"tag":274,"props":1953,"children":1954},{"style":287},[1955],{"type":50,"value":589},{"type":45,"tag":274,"props":1957,"children":1958},{"style":443},[1959],{"type":50,"value":446},{"type":45,"tag":274,"props":1961,"children":1962},{"style":371},[1963],{"type":50,"value":451},{"type":45,"tag":274,"props":1965,"children":1966},{"style":287},[1967],{"type":50,"value":749},{"type":45,"tag":274,"props":1969,"children":1970},{"style":287},[1971],{"type":50,"value":1418},{"type":45,"tag":274,"props":1973,"children":1974},{"style":443},[1975],{"type":50,"value":994},{"type":45,"tag":274,"props":1977,"children":1979},{"class":276,"line":1978},16,[1980,1985,1990,1995,2000,2004,2009],{"type":45,"tag":274,"props":1981,"children":1982},{"style":287},[1983],{"type":50,"value":1984}," -o",{"type":45,"tag":274,"props":1986,"children":1987},{"style":287},[1988],{"type":50,"value":1989}," custom-columns=NAME:.metadata.name,GENERATION:.metadata.generation,OBSERVED:.status.observedGeneration,PHASE:.status.phase,HASH:.metadata.annotations[",{"type":45,"tag":274,"props":1991,"children":1992},{"style":371},[1993],{"type":50,"value":1994},"\"",{"type":45,"tag":274,"props":1996,"children":1997},{"style":287},[1998],{"type":50,"value":1999},"crdb.cockroachlabs.com\u002Fhash-revision",{"type":45,"tag":274,"props":2001,"children":2002},{"style":371},[2003],{"type":50,"value":1994},{"type":45,"tag":274,"props":2005,"children":2006},{"style":287},[2007],{"type":50,"value":2008},"],NODE_ID:.status.nodeID",{"type":45,"tag":274,"props":2010,"children":2011},{"style":443},[2012],{"type":50,"value":994},{"type":45,"tag":274,"props":2014,"children":2016},{"class":276,"line":2015},17,[2017,2022],{"type":45,"tag":274,"props":2018,"children":2019},{"style":371},[2020],{"type":50,"value":2021}," >",{"type":45,"tag":274,"props":2023,"children":2024},{"style":287},[2025],{"type":50,"value":2026}," crdb-operator-escalation\u002Fcrdbnodes-summary.txt\n",{"type":45,"tag":59,"props":2028,"children":2030},{"id":2029},"step-3-logs",[2031],{"type":50,"value":2032},"Step 3: Logs",{"type":45,"tag":53,"props":2034,"children":2035},{},[2036],{"type":50,"value":2037},"Collect full recent logs, not filtered snippets:",{"type":45,"tag":263,"props":2039,"children":2041},{"className":265,"code":2040,"language":267,"meta":268,"style":268},"kubectl -n \u003Coperator-namespace> logs -l app=cockroach-operator --tail=500 > crdb-operator-escalation\u002Foperator-logs.txt 2>&1\nkubectl -n \u003Coperator-namespace> logs -l app=cockroach-operator --previous --tail=500 > crdb-operator-escalation\u002Foperator-previous-logs.txt 2>&1 || true\n",[2042],{"type":45,"tag":115,"props":2043,"children":2044},{"__ignoreMap":268},[2045,2103],{"type":45,"tag":274,"props":2046,"children":2047},{"class":276,"line":277},[2048,2052,2056,2060,2064,2068,2072,2077,2081,2085,2090,2094,2099],{"type":45,"tag":274,"props":2049,"children":2050},{"style":281},[2051],{"type":50,"value":358},{"type":45,"tag":274,"props":2053,"children":2054},{"style":287},[2055],{"type":50,"value":430},{"type":45,"tag":274,"props":2057,"children":2058},{"style":371},[2059],{"type":50,"value":435},{"type":45,"tag":274,"props":2061,"children":2062},{"style":287},[2063],{"type":50,"value":440},{"type":45,"tag":274,"props":2065,"children":2066},{"style":443},[2067],{"type":50,"value":446},{"type":45,"tag":274,"props":2069,"children":2070},{"style":371},[2071],{"type":50,"value":451},{"type":45,"tag":274,"props":2073,"children":2074},{"style":287},[2075],{"type":50,"value":2076}," logs",{"type":45,"tag":274,"props":2078,"children":2079},{"style":287},[2080],{"type":50,"value":1176},{"type":45,"tag":274,"props":2082,"children":2083},{"style":287},[2084],{"type":50,"value":1181},{"type":45,"tag":274,"props":2086,"children":2087},{"style":287},[2088],{"type":50,"value":2089}," --tail=500",{"type":45,"tag":274,"props":2091,"children":2092},{"style":371},[2093],{"type":50,"value":374},{"type":45,"tag":274,"props":2095,"children":2096},{"style":287},[2097],{"type":50,"value":2098}," crdb-operator-escalation\u002Foperator-logs.txt",{"type":45,"tag":274,"props":2100,"children":2101},{"style":371},[2102],{"type":50,"value":1020},{"type":45,"tag":274,"props":2104,"children":2105},{"class":276,"line":382},[2106,2110,2114,2118,2122,2126,2130,2134,2138,2142,2147,2151,2155,2160,2164,2168],{"type":45,"tag":274,"props":2107,"children":2108},{"style":281},[2109],{"type":50,"value":358},{"type":45,"tag":274,"props":2111,"children":2112},{"style":287},[2113],{"type":50,"value":430},{"type":45,"tag":274,"props":2115,"children":2116},{"style":371},[2117],{"type":50,"value":435},{"type":45,"tag":274,"props":2119,"children":2120},{"style":287},[2121],{"type":50,"value":440},{"type":45,"tag":274,"props":2123,"children":2124},{"style":443},[2125],{"type":50,"value":446},{"type":45,"tag":274,"props":2127,"children":2128},{"style":371},[2129],{"type":50,"value":451},{"type":45,"tag":274,"props":2131,"children":2132},{"style":287},[2133],{"type":50,"value":2076},{"type":45,"tag":274,"props":2135,"children":2136},{"style":287},[2137],{"type":50,"value":1176},{"type":45,"tag":274,"props":2139,"children":2140},{"style":287},[2141],{"type":50,"value":1181},{"type":45,"tag":274,"props":2143,"children":2144},{"style":287},[2145],{"type":50,"value":2146}," --previous",{"type":45,"tag":274,"props":2148,"children":2149},{"style":287},[2150],{"type":50,"value":2089},{"type":45,"tag":274,"props":2152,"children":2153},{"style":371},[2154],{"type":50,"value":374},{"type":45,"tag":274,"props":2156,"children":2157},{"style":287},[2158],{"type":50,"value":2159}," crdb-operator-escalation\u002Foperator-previous-logs.txt",{"type":45,"tag":274,"props":2161,"children":2162},{"style":371},[2163],{"type":50,"value":487},{"type":45,"tag":274,"props":2165,"children":2166},{"style":371},[2167],{"type":50,"value":492},{"type":45,"tag":274,"props":2169,"children":2170},{"style":495},[2171],{"type":50,"value":498},{"type":45,"tag":53,"props":2173,"children":2174},{},[2175],{"type":50,"value":2176},"For each CockroachDB pod:",{"type":45,"tag":263,"props":2178,"children":2180},{"className":265,"code":2179,"language":267,"meta":268,"style":268},"kubectl -n \u003Ccockroachdb-namespace> logs \u003Ccrdb-pod> -c cockroachdb --tail=500 > crdb-operator-escalation\u002F\u003Ccrdb-pod>-cockroachdb.log 2>&1\nkubectl -n \u003Ccockroachdb-namespace> logs \u003Ccrdb-pod> -c cockroachdb --previous --tail=500 > crdb-operator-escalation\u002F\u003Ccrdb-pod>-cockroachdb-previous.log 2>&1 || true\nkubectl -n \u003Ccockroachdb-namespace> logs \u003Ccrdb-pod> -c cert-reloader --tail=100 > crdb-operator-escalation\u002F\u003Ccrdb-pod>-cert-reloader.log 2>&1 || true\n",[2181],{"type":45,"tag":115,"props":2182,"children":2183},{"__ignoreMap":268},[2184,2279,2383],{"type":45,"tag":274,"props":2185,"children":2186},{"class":276,"line":277},[2187,2191,2195,2199,2203,2207,2211,2215,2219,2224,2228,2232,2236,2240,2244,2248,2253,2258,2262,2266,2270,2275],{"type":45,"tag":274,"props":2188,"children":2189},{"style":281},[2190],{"type":50,"value":358},{"type":45,"tag":274,"props":2192,"children":2193},{"style":287},[2194],{"type":50,"value":430},{"type":45,"tag":274,"props":2196,"children":2197},{"style":371},[2198],{"type":50,"value":435},{"type":45,"tag":274,"props":2200,"children":2201},{"style":287},[2202],{"type":50,"value":589},{"type":45,"tag":274,"props":2204,"children":2205},{"style":443},[2206],{"type":50,"value":446},{"type":45,"tag":274,"props":2208,"children":2209},{"style":371},[2210],{"type":50,"value":451},{"type":45,"tag":274,"props":2212,"children":2213},{"style":287},[2214],{"type":50,"value":2076},{"type":45,"tag":274,"props":2216,"children":2217},{"style":371},[2218],{"type":50,"value":435},{"type":45,"tag":274,"props":2220,"children":2221},{"style":287},[2222],{"type":50,"value":2223},"crdb-po",{"type":45,"tag":274,"props":2225,"children":2226},{"style":443},[2227],{"type":50,"value":970},{"type":45,"tag":274,"props":2229,"children":2230},{"style":371},[2231],{"type":50,"value":451},{"type":45,"tag":274,"props":2233,"children":2234},{"style":287},[2235],{"type":50,"value":979},{"type":45,"tag":274,"props":2237,"children":2238},{"style":287},[2239],{"type":50,"value":984},{"type":45,"tag":274,"props":2241,"children":2242},{"style":287},[2243],{"type":50,"value":2089},{"type":45,"tag":274,"props":2245,"children":2246},{"style":371},[2247],{"type":50,"value":374},{"type":45,"tag":274,"props":2249,"children":2250},{"style":287},[2251],{"type":50,"value":2252}," crdb-operator-escalation\u002F",{"type":45,"tag":274,"props":2254,"children":2255},{"style":371},[2256],{"type":50,"value":2257},"\u003C",{"type":45,"tag":274,"props":2259,"children":2260},{"style":287},[2261],{"type":50,"value":2223},{"type":45,"tag":274,"props":2263,"children":2264},{"style":443},[2265],{"type":50,"value":970},{"type":45,"tag":274,"props":2267,"children":2268},{"style":371},[2269],{"type":50,"value":451},{"type":45,"tag":274,"props":2271,"children":2272},{"style":287},[2273],{"type":50,"value":2274},"-cockroachdb.log",{"type":45,"tag":274,"props":2276,"children":2277},{"style":371},[2278],{"type":50,"value":1020},{"type":45,"tag":274,"props":2280,"children":2281},{"class":276,"line":382},[2282,2286,2290,2294,2298,2302,2306,2310,2314,2318,2322,2326,2330,2334,2338,2342,2346,2350,2354,2358,2362,2366,2371,2375,2379],{"type":45,"tag":274,"props":2283,"children":2284},{"style":281},[2285],{"type":50,"value":358},{"type":45,"tag":274,"props":2287,"children":2288},{"style":287},[2289],{"type":50,"value":430},{"type":45,"tag":274,"props":2291,"children":2292},{"style":371},[2293],{"type":50,"value":435},{"type":45,"tag":274,"props":2295,"children":2296},{"style":287},[2297],{"type":50,"value":589},{"type":45,"tag":274,"props":2299,"children":2300},{"style":443},[2301],{"type":50,"value":446},{"type":45,"tag":274,"props":2303,"children":2304},{"style":371},[2305],{"type":50,"value":451},{"type":45,"tag":274,"props":2307,"children":2308},{"style":287},[2309],{"type":50,"value":2076},{"type":45,"tag":274,"props":2311,"children":2312},{"style":371},[2313],{"type":50,"value":435},{"type":45,"tag":274,"props":2315,"children":2316},{"style":287},[2317],{"type":50,"value":2223},{"type":45,"tag":274,"props":2319,"children":2320},{"style":443},[2321],{"type":50,"value":970},{"type":45,"tag":274,"props":2323,"children":2324},{"style":371},[2325],{"type":50,"value":451},{"type":45,"tag":274,"props":2327,"children":2328},{"style":287},[2329],{"type":50,"value":979},{"type":45,"tag":274,"props":2331,"children":2332},{"style":287},[2333],{"type":50,"value":984},{"type":45,"tag":274,"props":2335,"children":2336},{"style":287},[2337],{"type":50,"value":2146},{"type":45,"tag":274,"props":2339,"children":2340},{"style":287},[2341],{"type":50,"value":2089},{"type":45,"tag":274,"props":2343,"children":2344},{"style":371},[2345],{"type":50,"value":374},{"type":45,"tag":274,"props":2347,"children":2348},{"style":287},[2349],{"type":50,"value":2252},{"type":45,"tag":274,"props":2351,"children":2352},{"style":371},[2353],{"type":50,"value":2257},{"type":45,"tag":274,"props":2355,"children":2356},{"style":287},[2357],{"type":50,"value":2223},{"type":45,"tag":274,"props":2359,"children":2360},{"style":443},[2361],{"type":50,"value":970},{"type":45,"tag":274,"props":2363,"children":2364},{"style":371},[2365],{"type":50,"value":451},{"type":45,"tag":274,"props":2367,"children":2368},{"style":287},[2369],{"type":50,"value":2370},"-cockroachdb-previous.log",{"type":45,"tag":274,"props":2372,"children":2373},{"style":371},[2374],{"type":50,"value":487},{"type":45,"tag":274,"props":2376,"children":2377},{"style":371},[2378],{"type":50,"value":492},{"type":45,"tag":274,"props":2380,"children":2381},{"style":495},[2382],{"type":50,"value":498},{"type":45,"tag":274,"props":2384,"children":2385},{"class":276,"line":409},[2386,2390,2394,2398,2402,2406,2410,2414,2418,2422,2426,2430,2434,2439,2444,2448,2452,2456,2460,2464,2468,2473,2477,2481],{"type":45,"tag":274,"props":2387,"children":2388},{"style":281},[2389],{"type":50,"value":358},{"type":45,"tag":274,"props":2391,"children":2392},{"style":287},[2393],{"type":50,"value":430},{"type":45,"tag":274,"props":2395,"children":2396},{"style":371},[2397],{"type":50,"value":435},{"type":45,"tag":274,"props":2399,"children":2400},{"style":287},[2401],{"type":50,"value":589},{"type":45,"tag":274,"props":2403,"children":2404},{"style":443},[2405],{"type":50,"value":446},{"type":45,"tag":274,"props":2407,"children":2408},{"style":371},[2409],{"type":50,"value":451},{"type":45,"tag":274,"props":2411,"children":2412},{"style":287},[2413],{"type":50,"value":2076},{"type":45,"tag":274,"props":2415,"children":2416},{"style":371},[2417],{"type":50,"value":435},{"type":45,"tag":274,"props":2419,"children":2420},{"style":287},[2421],{"type":50,"value":2223},{"type":45,"tag":274,"props":2423,"children":2424},{"style":443},[2425],{"type":50,"value":970},{"type":45,"tag":274,"props":2427,"children":2428},{"style":371},[2429],{"type":50,"value":451},{"type":45,"tag":274,"props":2431,"children":2432},{"style":287},[2433],{"type":50,"value":979},{"type":45,"tag":274,"props":2435,"children":2436},{"style":287},[2437],{"type":50,"value":2438}," cert-reloader",{"type":45,"tag":274,"props":2440,"children":2441},{"style":287},[2442],{"type":50,"value":2443}," --tail=100",{"type":45,"tag":274,"props":2445,"children":2446},{"style":371},[2447],{"type":50,"value":374},{"type":45,"tag":274,"props":2449,"children":2450},{"style":287},[2451],{"type":50,"value":2252},{"type":45,"tag":274,"props":2453,"children":2454},{"style":371},[2455],{"type":50,"value":2257},{"type":45,"tag":274,"props":2457,"children":2458},{"style":287},[2459],{"type":50,"value":2223},{"type":45,"tag":274,"props":2461,"children":2462},{"style":443},[2463],{"type":50,"value":970},{"type":45,"tag":274,"props":2465,"children":2466},{"style":371},[2467],{"type":50,"value":451},{"type":45,"tag":274,"props":2469,"children":2470},{"style":287},[2471],{"type":50,"value":2472},"-cert-reloader.log",{"type":45,"tag":274,"props":2474,"children":2475},{"style":371},[2476],{"type":50,"value":487},{"type":45,"tag":274,"props":2478,"children":2479},{"style":371},[2480],{"type":50,"value":492},{"type":45,"tag":274,"props":2482,"children":2483},{"style":495},[2484],{"type":50,"value":498},{"type":45,"tag":59,"props":2486,"children":2488},{"id":2487},"step-4-operation-specific-evidence",[2489],{"type":50,"value":2490},"Step 4: Operation-Specific Evidence",{"type":45,"tag":2492,"props":2493,"children":2495},"h3",{"id":2494},"upgrade",[2496],{"type":50,"value":2497},"Upgrade",{"type":45,"tag":263,"props":2499,"children":2501},{"className":265,"code":2500,"language":267,"meta":268,"style":268},"kubectl -n \u003Ccockroachdb-namespace> get crdbcluster \u003Ccockroachdb-release> -o json | jq '{\n specImage: .spec.image,\n statusImage: .status.image,\n actions: .status.actions,\n annotations: .metadata.annotations,\n conditions: [.status.conditions[]? | select(.type | test(\"Upgrade|Version|Validate\"))]\n}' > crdb-operator-escalation\u002Fupgrade-status.json\n\nkubectl -n \u003Ccockroachdb-namespace> get jobs -o wide > crdb-operator-escalation\u002Fjobs.txt\nkubectl -n \u003Ccockroachdb-namespace> get pods -o custom-columns=NAME:.metadata.name,IMAGE:.spec.containers[0].image,PHASE:.status.phase > crdb-operator-escalation\u002Fpod-images.txt\nkubectl -n \u003Ccockroachdb-namespace> describe job \u003Cversion-checker-job> > crdb-operator-escalation\u002Fversion-checker-job.txt 2>&1 || true\nkubectl -n \u003Ccockroachdb-namespace> logs -l job-name=\u003Cversion-checker-job> > crdb-operator-escalation\u002Fversion-checker-logs.txt 2>&1 || true\n",[2502],{"type":45,"tag":115,"props":2503,"children":2504},{"__ignoreMap":268},[2505,2580,2588,2595,2602,2610,2618,2638,2645,2698,2751,2826],{"type":45,"tag":274,"props":2506,"children":2507},{"class":276,"line":277},[2508,2512,2516,2520,2524,2528,2532,2536,2540,2544,2548,2552,2556,2560,2564,2568,2572,2576],{"type":45,"tag":274,"props":2509,"children":2510},{"style":281},[2511],{"type":50,"value":358},{"type":45,"tag":274,"props":2513,"children":2514},{"style":287},[2515],{"type":50,"value":430},{"type":45,"tag":274,"props":2517,"children":2518},{"style":371},[2519],{"type":50,"value":435},{"type":45,"tag":274,"props":2521,"children":2522},{"style":287},[2523],{"type":50,"value":589},{"type":45,"tag":274,"props":2525,"children":2526},{"style":443},[2527],{"type":50,"value":446},{"type":45,"tag":274,"props":2529,"children":2530},{"style":371},[2531],{"type":50,"value":451},{"type":45,"tag":274,"props":2533,"children":2534},{"style":287},[2535],{"type":50,"value":749},{"type":45,"tag":274,"props":2537,"children":2538},{"style":287},[2539],{"type":50,"value":1289},{"type":45,"tag":274,"props":2541,"children":2542},{"style":371},[2543],{"type":50,"value":435},{"type":45,"tag":274,"props":2545,"children":2546},{"style":287},[2547],{"type":50,"value":610},{"type":45,"tag":274,"props":2549,"children":2550},{"style":443},[2551],{"type":50,"value":446},{"type":45,"tag":274,"props":2553,"children":2554},{"style":371},[2555],{"type":50,"value":451},{"type":45,"tag":274,"props":2557,"children":2558},{"style":287},[2559],{"type":50,"value":764},{"type":45,"tag":274,"props":2561,"children":2562},{"style":287},[2563],{"type":50,"value":1799},{"type":45,"tag":274,"props":2565,"children":2566},{"style":371},[2567],{"type":50,"value":1804},{"type":45,"tag":274,"props":2569,"children":2570},{"style":281},[2571],{"type":50,"value":1809},{"type":45,"tag":274,"props":2573,"children":2574},{"style":371},[2575],{"type":50,"value":1814},{"type":45,"tag":274,"props":2577,"children":2578},{"style":287},[2579],{"type":50,"value":1819},{"type":45,"tag":274,"props":2581,"children":2582},{"class":276,"line":382},[2583],{"type":45,"tag":274,"props":2584,"children":2585},{"style":287},[2586],{"type":50,"value":2587}," specImage: .spec.image,\n",{"type":45,"tag":274,"props":2589,"children":2590},{"class":276,"line":409},[2591],{"type":45,"tag":274,"props":2592,"children":2593},{"style":287},[2594],{"type":50,"value":1875},{"type":45,"tag":274,"props":2596,"children":2597},{"class":276,"line":419},[2598],{"type":45,"tag":274,"props":2599,"children":2600},{"style":287},[2601],{"type":50,"value":1883},{"type":45,"tag":274,"props":2603,"children":2604},{"class":276,"line":501},[2605],{"type":45,"tag":274,"props":2606,"children":2607},{"style":287},[2608],{"type":50,"value":2609}," annotations: .metadata.annotations,\n",{"type":45,"tag":274,"props":2611,"children":2612},{"class":276,"line":571},[2613],{"type":45,"tag":274,"props":2614,"children":2615},{"style":287},[2616],{"type":50,"value":2617}," conditions: [.status.conditions[]? | select(.type | test(\"Upgrade|Version|Validate\"))]\n",{"type":45,"tag":274,"props":2619,"children":2620},{"class":276,"line":642},[2621,2625,2629,2633],{"type":45,"tag":274,"props":2622,"children":2623},{"style":287},[2624],{"type":50,"value":1915},{"type":45,"tag":274,"props":2626,"children":2627},{"style":371},[2628],{"type":50,"value":774},{"type":45,"tag":274,"props":2630,"children":2631},{"style":371},[2632],{"type":50,"value":374},{"type":45,"tag":274,"props":2634,"children":2635},{"style":287},[2636],{"type":50,"value":2637}," crdb-operator-escalation\u002Fupgrade-status.json\n",{"type":45,"tag":274,"props":2639,"children":2640},{"class":276,"line":711},[2641],{"type":45,"tag":274,"props":2642,"children":2643},{"emptyLinePlaceholder":413},[2644],{"type":50,"value":416},{"type":45,"tag":274,"props":2646,"children":2647},{"class":276,"line":719},[2648,2652,2656,2660,2664,2668,2672,2676,2681,2685,2689,2693],{"type":45,"tag":274,"props":2649,"children":2650},{"style":281},[2651],{"type":50,"value":358},{"type":45,"tag":274,"props":2653,"children":2654},{"style":287},[2655],{"type":50,"value":430},{"type":45,"tag":274,"props":2657,"children":2658},{"style":371},[2659],{"type":50,"value":435},{"type":45,"tag":274,"props":2661,"children":2662},{"style":287},[2663],{"type":50,"value":589},{"type":45,"tag":274,"props":2665,"children":2666},{"style":443},[2667],{"type":50,"value":446},{"type":45,"tag":274,"props":2669,"children":2670},{"style":371},[2671],{"type":50,"value":451},{"type":45,"tag":274,"props":2673,"children":2674},{"style":287},[2675],{"type":50,"value":749},{"type":45,"tag":274,"props":2677,"children":2678},{"style":287},[2679],{"type":50,"value":2680}," jobs",{"type":45,"tag":274,"props":2682,"children":2683},{"style":287},[2684],{"type":50,"value":764},{"type":45,"tag":274,"props":2686,"children":2687},{"style":287},[2688],{"type":50,"value":828},{"type":45,"tag":274,"props":2690,"children":2691},{"style":371},[2692],{"type":50,"value":374},{"type":45,"tag":274,"props":2694,"children":2695},{"style":287},[2696],{"type":50,"value":2697}," crdb-operator-escalation\u002Fjobs.txt\n",{"type":45,"tag":274,"props":2699,"children":2700},{"class":276,"line":795},[2701,2705,2709,2713,2717,2721,2725,2729,2733,2737,2742,2746],{"type":45,"tag":274,"props":2702,"children":2703},{"style":281},[2704],{"type":50,"value":358},{"type":45,"tag":274,"props":2706,"children":2707},{"style":287},[2708],{"type":50,"value":430},{"type":45,"tag":274,"props":2710,"children":2711},{"style":371},[2712],{"type":50,"value":435},{"type":45,"tag":274,"props":2714,"children":2715},{"style":287},[2716],{"type":50,"value":589},{"type":45,"tag":274,"props":2718,"children":2719},{"style":443},[2720],{"type":50,"value":446},{"type":45,"tag":274,"props":2722,"children":2723},{"style":371},[2724],{"type":50,"value":451},{"type":45,"tag":274,"props":2726,"children":2727},{"style":287},[2728],{"type":50,"value":749},{"type":45,"tag":274,"props":2730,"children":2731},{"style":287},[2732],{"type":50,"value":1171},{"type":45,"tag":274,"props":2734,"children":2735},{"style":287},[2736],{"type":50,"value":764},{"type":45,"tag":274,"props":2738,"children":2739},{"style":287},[2740],{"type":50,"value":2741}," custom-columns=NAME:.metadata.name,IMAGE:.spec.containers[0].image,PHASE:.status.phase",{"type":45,"tag":274,"props":2743,"children":2744},{"style":371},[2745],{"type":50,"value":374},{"type":45,"tag":274,"props":2747,"children":2748},{"style":287},[2749],{"type":50,"value":2750}," crdb-operator-escalation\u002Fpod-images.txt\n",{"type":45,"tag":274,"props":2752,"children":2753},{"class":276,"line":840},[2754,2758,2762,2766,2770,2774,2778,2782,2787,2791,2796,2801,2805,2809,2814,2818,2822],{"type":45,"tag":274,"props":2755,"children":2756},{"style":281},[2757],{"type":50,"value":358},{"type":45,"tag":274,"props":2759,"children":2760},{"style":287},[2761],{"type":50,"value":430},{"type":45,"tag":274,"props":2763,"children":2764},{"style":371},[2765],{"type":50,"value":435},{"type":45,"tag":274,"props":2767,"children":2768},{"style":287},[2769],{"type":50,"value":589},{"type":45,"tag":274,"props":2771,"children":2772},{"style":443},[2773],{"type":50,"value":446},{"type":45,"tag":274,"props":2775,"children":2776},{"style":371},[2777],{"type":50,"value":451},{"type":45,"tag":274,"props":2779,"children":2780},{"style":287},[2781],{"type":50,"value":1118},{"type":45,"tag":274,"props":2783,"children":2784},{"style":287},[2785],{"type":50,"value":2786}," job",{"type":45,"tag":274,"props":2788,"children":2789},{"style":371},[2790],{"type":50,"value":435},{"type":45,"tag":274,"props":2792,"children":2793},{"style":287},[2794],{"type":50,"value":2795},"version-checker-jo",{"type":45,"tag":274,"props":2797,"children":2798},{"style":443},[2799],{"type":50,"value":2800},"b",{"type":45,"tag":274,"props":2802,"children":2803},{"style":371},[2804],{"type":50,"value":451},{"type":45,"tag":274,"props":2806,"children":2807},{"style":371},[2808],{"type":50,"value":374},{"type":45,"tag":274,"props":2810,"children":2811},{"style":287},[2812],{"type":50,"value":2813}," crdb-operator-escalation\u002Fversion-checker-job.txt",{"type":45,"tag":274,"props":2815,"children":2816},{"style":371},[2817],{"type":50,"value":487},{"type":45,"tag":274,"props":2819,"children":2820},{"style":371},[2821],{"type":50,"value":492},{"type":45,"tag":274,"props":2823,"children":2824},{"style":495},[2825],{"type":50,"value":498},{"type":45,"tag":274,"props":2827,"children":2828},{"class":276,"line":878},[2829,2833,2837,2841,2845,2849,2853,2857,2861,2866,2870,2874,2878,2882,2886,2891,2895,2899],{"type":45,"tag":274,"props":2830,"children":2831},{"style":281},[2832],{"type":50,"value":358},{"type":45,"tag":274,"props":2834,"children":2835},{"style":287},[2836],{"type":50,"value":430},{"type":45,"tag":274,"props":2838,"children":2839},{"style":371},[2840],{"type":50,"value":435},{"type":45,"tag":274,"props":2842,"children":2843},{"style":287},[2844],{"type":50,"value":589},{"type":45,"tag":274,"props":2846,"children":2847},{"style":443},[2848],{"type":50,"value":446},{"type":45,"tag":274,"props":2850,"children":2851},{"style":371},[2852],{"type":50,"value":451},{"type":45,"tag":274,"props":2854,"children":2855},{"style":287},[2856],{"type":50,"value":2076},{"type":45,"tag":274,"props":2858,"children":2859},{"style":287},[2860],{"type":50,"value":1176},{"type":45,"tag":274,"props":2862,"children":2863},{"style":287},[2864],{"type":50,"value":2865}," job-name=",{"type":45,"tag":274,"props":2867,"children":2868},{"style":371},[2869],{"type":50,"value":2257},{"type":45,"tag":274,"props":2871,"children":2872},{"style":287},[2873],{"type":50,"value":2795},{"type":45,"tag":274,"props":2875,"children":2876},{"style":443},[2877],{"type":50,"value":2800},{"type":45,"tag":274,"props":2879,"children":2880},{"style":371},[2881],{"type":50,"value":451},{"type":45,"tag":274,"props":2883,"children":2884},{"style":371},[2885],{"type":50,"value":374},{"type":45,"tag":274,"props":2887,"children":2888},{"style":287},[2889],{"type":50,"value":2890}," crdb-operator-escalation\u002Fversion-checker-logs.txt",{"type":45,"tag":274,"props":2892,"children":2893},{"style":371},[2894],{"type":50,"value":487},{"type":45,"tag":274,"props":2896,"children":2897},{"style":371},[2898],{"type":50,"value":492},{"type":45,"tag":274,"props":2900,"children":2901},{"style":495},[2902],{"type":50,"value":498},{"type":45,"tag":53,"props":2904,"children":2905},{},[2906],{"type":50,"value":2907},"Include current and target CRDB image and whether any version checker job or pod was deleted.",{"type":45,"tag":2492,"props":2909,"children":2911},{"id":2910},"scale-down-or-decommission",[2912],{"type":50,"value":2913},"Scale Down or Decommission",{"type":45,"tag":263,"props":2915,"children":2917},{"className":265,"code":2916,"language":267,"meta":268,"style":268},"kubectl -n \u003Ccockroachdb-namespace> exec \u003Cready-crdb-pod> -c cockroachdb -- \\\n \u002Fcockroach\u002Fcockroach node status --decommission > crdb-operator-escalation\u002Fnode-decommission-status.txt 2>&1\n\nkubectl -n \u003Ccockroachdb-namespace> get crdbnodes -o json | jq '[.items[] | select(.status.phase==\"Decommissioning\")] | {count: length, nodes: [.[].metadata.name]}' \\\n > crdb-operator-escalation\u002Fdecommissioning-crdbnodes.json\n",[2918],{"type":45,"tag":115,"props":2919,"children":2920},{"__ignoreMap":268},[2921,2984,3018,3025,3093],{"type":45,"tag":274,"props":2922,"children":2923},{"class":276,"line":277},[2924,2928,2932,2936,2940,2944,2948,2952,2956,2960,2964,2968,2972,2976,2980],{"type":45,"tag":274,"props":2925,"children":2926},{"style":281},[2927],{"type":50,"value":358},{"type":45,"tag":274,"props":2929,"children":2930},{"style":287},[2931],{"type":50,"value":430},{"type":45,"tag":274,"props":2933,"children":2934},{"style":371},[2935],{"type":50,"value":435},{"type":45,"tag":274,"props":2937,"children":2938},{"style":287},[2939],{"type":50,"value":589},{"type":45,"tag":274,"props":2941,"children":2942},{"style":443},[2943],{"type":50,"value":446},{"type":45,"tag":274,"props":2945,"children":2946},{"style":371},[2947],{"type":50,"value":451},{"type":45,"tag":274,"props":2949,"children":2950},{"style":287},[2951],{"type":50,"value":956},{"type":45,"tag":274,"props":2953,"children":2954},{"style":371},[2955],{"type":50,"value":435},{"type":45,"tag":274,"props":2957,"children":2958},{"style":287},[2959],{"type":50,"value":965},{"type":45,"tag":274,"props":2961,"children":2962},{"style":443},[2963],{"type":50,"value":970},{"type":45,"tag":274,"props":2965,"children":2966},{"style":371},[2967],{"type":50,"value":451},{"type":45,"tag":274,"props":2969,"children":2970},{"style":287},[2971],{"type":50,"value":979},{"type":45,"tag":274,"props":2973,"children":2974},{"style":287},[2975],{"type":50,"value":984},{"type":45,"tag":274,"props":2977,"children":2978},{"style":287},[2979],{"type":50,"value":989},{"type":45,"tag":274,"props":2981,"children":2982},{"style":443},[2983],{"type":50,"value":994},{"type":45,"tag":274,"props":2985,"children":2986},{"class":276,"line":382},[2987,2991,2996,3000,3005,3009,3014],{"type":45,"tag":274,"props":2988,"children":2989},{"style":287},[2990],{"type":50,"value":1002},{"type":45,"tag":274,"props":2992,"children":2993},{"style":287},[2994],{"type":50,"value":2995}," node",{"type":45,"tag":274,"props":2997,"children":2998},{"style":287},[2999],{"type":50,"value":456},{"type":45,"tag":274,"props":3001,"children":3002},{"style":287},[3003],{"type":50,"value":3004}," --decommission",{"type":45,"tag":274,"props":3006,"children":3007},{"style":371},[3008],{"type":50,"value":374},{"type":45,"tag":274,"props":3010,"children":3011},{"style":287},[3012],{"type":50,"value":3013}," crdb-operator-escalation\u002Fnode-decommission-status.txt",{"type":45,"tag":274,"props":3015,"children":3016},{"style":371},[3017],{"type":50,"value":1020},{"type":45,"tag":274,"props":3019,"children":3020},{"class":276,"line":409},[3021],{"type":45,"tag":274,"props":3022,"children":3023},{"emptyLinePlaceholder":413},[3024],{"type":50,"value":416},{"type":45,"tag":274,"props":3026,"children":3027},{"class":276,"line":419},[3028,3032,3036,3040,3044,3048,3052,3056,3060,3064,3068,3072,3076,3080,3085,3089],{"type":45,"tag":274,"props":3029,"children":3030},{"style":281},[3031],{"type":50,"value":358},{"type":45,"tag":274,"props":3033,"children":3034},{"style":287},[3035],{"type":50,"value":430},{"type":45,"tag":274,"props":3037,"children":3038},{"style":371},[3039],{"type":50,"value":435},{"type":45,"tag":274,"props":3041,"children":3042},{"style":287},[3043],{"type":50,"value":589},{"type":45,"tag":274,"props":3045,"children":3046},{"style":443},[3047],{"type":50,"value":446},{"type":45,"tag":274,"props":3049,"children":3050},{"style":371},[3051],{"type":50,"value":451},{"type":45,"tag":274,"props":3053,"children":3054},{"style":287},[3055],{"type":50,"value":749},{"type":45,"tag":274,"props":3057,"children":3058},{"style":287},[3059],{"type":50,"value":1418},{"type":45,"tag":274,"props":3061,"children":3062},{"style":287},[3063],{"type":50,"value":764},{"type":45,"tag":274,"props":3065,"children":3066},{"style":287},[3067],{"type":50,"value":1799},{"type":45,"tag":274,"props":3069,"children":3070},{"style":371},[3071],{"type":50,"value":1804},{"type":45,"tag":274,"props":3073,"children":3074},{"style":281},[3075],{"type":50,"value":1809},{"type":45,"tag":274,"props":3077,"children":3078},{"style":371},[3079],{"type":50,"value":1814},{"type":45,"tag":274,"props":3081,"children":3082},{"style":287},[3083],{"type":50,"value":3084},"[.items[] | select(.status.phase==\"Decommissioning\")] | {count: length, nodes: [.[].metadata.name]}",{"type":45,"tag":274,"props":3086,"children":3087},{"style":371},[3088],{"type":50,"value":774},{"type":45,"tag":274,"props":3090,"children":3091},{"style":443},[3092],{"type":50,"value":994},{"type":45,"tag":274,"props":3094,"children":3095},{"class":276,"line":501},[3096,3100],{"type":45,"tag":274,"props":3097,"children":3098},{"style":371},[3099],{"type":50,"value":2021},{"type":45,"tag":274,"props":3101,"children":3102},{"style":287},[3103],{"type":50,"value":3104}," crdb-operator-escalation\u002Fdecommissioning-crdbnodes.json\n",{"type":45,"tag":53,"props":3106,"children":3107},{},[3108],{"type":50,"value":3109},"Include original and target node count, whether multiple nodes changed at once, and whether manual drain\u002Fdecommission was attempted.",{"type":45,"tag":2492,"props":3111,"children":3113},{"id":3112},"scale-up",[3114],{"type":50,"value":3115},"Scale Up",{"type":45,"tag":53,"props":3117,"children":3118},{},[3119],{"type":50,"value":3120},"Capture whether machines, Kubernetes nodes, disks, storage classes, topology spread constraints, or node labels changed:",{"type":45,"tag":263,"props":3122,"children":3124},{"className":265,"code":3123,"language":267,"meta":268,"style":268},"kubectl get nodes -L topology.kubernetes.io\u002Fregion,topology.kubernetes.io\u002Fzone > crdb-operator-escalation\u002Fnodes-locality.txt\nkubectl get storageclass > crdb-operator-escalation\u002Fstorageclasses.txt\nkubectl -n \u003Ccockroachdb-namespace> get pvc -o wide > crdb-operator-escalation\u002Fpvc-wide.txt\n",[3125],{"type":45,"tag":115,"props":3126,"children":3127},{"__ignoreMap":268},[3128,3163,3188],{"type":45,"tag":274,"props":3129,"children":3130},{"class":276,"line":277},[3131,3135,3139,3144,3149,3154,3158],{"type":45,"tag":274,"props":3132,"children":3133},{"style":281},[3134],{"type":50,"value":358},{"type":45,"tag":274,"props":3136,"children":3137},{"style":287},[3138],{"type":50,"value":749},{"type":45,"tag":274,"props":3140,"children":3141},{"style":287},[3142],{"type":50,"value":3143}," nodes",{"type":45,"tag":274,"props":3145,"children":3146},{"style":287},[3147],{"type":50,"value":3148}," -L",{"type":45,"tag":274,"props":3150,"children":3151},{"style":287},[3152],{"type":50,"value":3153}," topology.kubernetes.io\u002Fregion,topology.kubernetes.io\u002Fzone",{"type":45,"tag":274,"props":3155,"children":3156},{"style":371},[3157],{"type":50,"value":374},{"type":45,"tag":274,"props":3159,"children":3160},{"style":287},[3161],{"type":50,"value":3162}," crdb-operator-escalation\u002Fnodes-locality.txt\n",{"type":45,"tag":274,"props":3164,"children":3165},{"class":276,"line":382},[3166,3170,3174,3179,3183],{"type":45,"tag":274,"props":3167,"children":3168},{"style":281},[3169],{"type":50,"value":358},{"type":45,"tag":274,"props":3171,"children":3172},{"style":287},[3173],{"type":50,"value":749},{"type":45,"tag":274,"props":3175,"children":3176},{"style":287},[3177],{"type":50,"value":3178}," storageclass",{"type":45,"tag":274,"props":3180,"children":3181},{"style":371},[3182],{"type":50,"value":374},{"type":45,"tag":274,"props":3184,"children":3185},{"style":287},[3186],{"type":50,"value":3187}," crdb-operator-escalation\u002Fstorageclasses.txt\n",{"type":45,"tag":274,"props":3189,"children":3190},{"class":276,"line":409},[3191,3195,3199,3203,3207,3211,3215,3219,3223,3227,3231,3235],{"type":45,"tag":274,"props":3192,"children":3193},{"style":281},[3194],{"type":50,"value":358},{"type":45,"tag":274,"props":3196,"children":3197},{"style":287},[3198],{"type":50,"value":430},{"type":45,"tag":274,"props":3200,"children":3201},{"style":371},[3202],{"type":50,"value":435},{"type":45,"tag":274,"props":3204,"children":3205},{"style":287},[3206],{"type":50,"value":589},{"type":45,"tag":274,"props":3208,"children":3209},{"style":443},[3210],{"type":50,"value":446},{"type":45,"tag":274,"props":3212,"children":3213},{"style":371},[3214],{"type":50,"value":451},{"type":45,"tag":274,"props":3216,"children":3217},{"style":287},[3218],{"type":50,"value":749},{"type":45,"tag":274,"props":3220,"children":3221},{"style":287},[3222],{"type":50,"value":1621},{"type":45,"tag":274,"props":3224,"children":3225},{"style":287},[3226],{"type":50,"value":764},{"type":45,"tag":274,"props":3228,"children":3229},{"style":287},[3230],{"type":50,"value":828},{"type":45,"tag":274,"props":3232,"children":3233},{"style":371},[3234],{"type":50,"value":374},{"type":45,"tag":274,"props":3236,"children":3237},{"style":287},[3238],{"type":50,"value":3239}," crdb-operator-escalation\u002Fpvc-wide.txt\n",{"type":45,"tag":2492,"props":3241,"children":3243},{"id":3242},"certificate-rotation",[3244],{"type":50,"value":3245},"Certificate Rotation",{"type":45,"tag":263,"props":3247,"children":3249},{"className":265,"code":3248,"language":267,"meta":268,"style":268},"kubectl -n \u003Ccockroachdb-namespace> get secret,configmap | grep -E 'ca|node|client|tls|cert' > crdb-operator-escalation\u002Fcert-resources.txt || true\nkubectl -n \u003Ccockroachdb-namespace> get certificate,issuer,clusterissuer -o wide > crdb-operator-escalation\u002Fcert-manager-resources.txt 2>&1 || true\n\nkubectl -n \u003Ccockroachdb-namespace> get secret \u003Cnode-tls-secret> -o jsonpath='{.data.tls\\.crt}' | base64 -d | \\\n openssl x509 -noout -dates -subject -issuer -ext subjectAltName > crdb-operator-escalation\u002Fnode-cert-metadata.txt\n",[3250],{"type":45,"tag":115,"props":3251,"children":3252},{"__ignoreMap":268},[3253,3333,3398,3405,3502],{"type":45,"tag":274,"props":3254,"children":3255},{"class":276,"line":277},[3256,3260,3264,3268,3272,3276,3280,3284,3289,3293,3298,3303,3307,3312,3316,3320,3325,3329],{"type":45,"tag":274,"props":3257,"children":3258},{"style":281},[3259],{"type":50,"value":358},{"type":45,"tag":274,"props":3261,"children":3262},{"style":287},[3263],{"type":50,"value":430},{"type":45,"tag":274,"props":3265,"children":3266},{"style":371},[3267],{"type":50,"value":435},{"type":45,"tag":274,"props":3269,"children":3270},{"style":287},[3271],{"type":50,"value":589},{"type":45,"tag":274,"props":3273,"children":3274},{"style":443},[3275],{"type":50,"value":446},{"type":45,"tag":274,"props":3277,"children":3278},{"style":371},[3279],{"type":50,"value":451},{"type":45,"tag":274,"props":3281,"children":3282},{"style":287},[3283],{"type":50,"value":749},{"type":45,"tag":274,"props":3285,"children":3286},{"style":287},[3287],{"type":50,"value":3288}," secret,configmap",{"type":45,"tag":274,"props":3290,"children":3291},{"style":371},[3292],{"type":50,"value":1804},{"type":45,"tag":274,"props":3294,"children":3295},{"style":281},[3296],{"type":50,"value":3297}," grep",{"type":45,"tag":274,"props":3299,"children":3300},{"style":287},[3301],{"type":50,"value":3302}," -E",{"type":45,"tag":274,"props":3304,"children":3305},{"style":371},[3306],{"type":50,"value":1814},{"type":45,"tag":274,"props":3308,"children":3309},{"style":287},[3310],{"type":50,"value":3311},"ca|node|client|tls|cert",{"type":45,"tag":274,"props":3313,"children":3314},{"style":371},[3315],{"type":50,"value":774},{"type":45,"tag":274,"props":3317,"children":3318},{"style":371},[3319],{"type":50,"value":374},{"type":45,"tag":274,"props":3321,"children":3322},{"style":287},[3323],{"type":50,"value":3324}," crdb-operator-escalation\u002Fcert-resources.txt",{"type":45,"tag":274,"props":3326,"children":3327},{"style":371},[3328],{"type":50,"value":492},{"type":45,"tag":274,"props":3330,"children":3331},{"style":495},[3332],{"type":50,"value":498},{"type":45,"tag":274,"props":3334,"children":3335},{"class":276,"line":382},[3336,3340,3344,3348,3352,3356,3360,3364,3369,3373,3377,3381,3386,3390,3394],{"type":45,"tag":274,"props":3337,"children":3338},{"style":281},[3339],{"type":50,"value":358},{"type":45,"tag":274,"props":3341,"children":3342},{"style":287},[3343],{"type":50,"value":430},{"type":45,"tag":274,"props":3345,"children":3346},{"style":371},[3347],{"type":50,"value":435},{"type":45,"tag":274,"props":3349,"children":3350},{"style":287},[3351],{"type":50,"value":589},{"type":45,"tag":274,"props":3353,"children":3354},{"style":443},[3355],{"type":50,"value":446},{"type":45,"tag":274,"props":3357,"children":3358},{"style":371},[3359],{"type":50,"value":451},{"type":45,"tag":274,"props":3361,"children":3362},{"style":287},[3363],{"type":50,"value":749},{"type":45,"tag":274,"props":3365,"children":3366},{"style":287},[3367],{"type":50,"value":3368}," certificate,issuer,clusterissuer",{"type":45,"tag":274,"props":3370,"children":3371},{"style":287},[3372],{"type":50,"value":764},{"type":45,"tag":274,"props":3374,"children":3375},{"style":287},[3376],{"type":50,"value":828},{"type":45,"tag":274,"props":3378,"children":3379},{"style":371},[3380],{"type":50,"value":374},{"type":45,"tag":274,"props":3382,"children":3383},{"style":287},[3384],{"type":50,"value":3385}," crdb-operator-escalation\u002Fcert-manager-resources.txt",{"type":45,"tag":274,"props":3387,"children":3388},{"style":371},[3389],{"type":50,"value":487},{"type":45,"tag":274,"props":3391,"children":3392},{"style":371},[3393],{"type":50,"value":492},{"type":45,"tag":274,"props":3395,"children":3396},{"style":495},[3397],{"type":50,"value":498},{"type":45,"tag":274,"props":3399,"children":3400},{"class":276,"line":409},[3401],{"type":45,"tag":274,"props":3402,"children":3403},{"emptyLinePlaceholder":413},[3404],{"type":50,"value":416},{"type":45,"tag":274,"props":3406,"children":3407},{"class":276,"line":419},[3408,3412,3416,3420,3424,3428,3432,3436,3441,3445,3450,3455,3459,3463,3467,3471,3476,3480,3484,3489,3494,3498],{"type":45,"tag":274,"props":3409,"children":3410},{"style":281},[3411],{"type":50,"value":358},{"type":45,"tag":274,"props":3413,"children":3414},{"style":287},[3415],{"type":50,"value":430},{"type":45,"tag":274,"props":3417,"children":3418},{"style":371},[3419],{"type":50,"value":435},{"type":45,"tag":274,"props":3421,"children":3422},{"style":287},[3423],{"type":50,"value":589},{"type":45,"tag":274,"props":3425,"children":3426},{"style":443},[3427],{"type":50,"value":446},{"type":45,"tag":274,"props":3429,"children":3430},{"style":371},[3431],{"type":50,"value":451},{"type":45,"tag":274,"props":3433,"children":3434},{"style":287},[3435],{"type":50,"value":749},{"type":45,"tag":274,"props":3437,"children":3438},{"style":287},[3439],{"type":50,"value":3440}," secret",{"type":45,"tag":274,"props":3442,"children":3443},{"style":371},[3444],{"type":50,"value":435},{"type":45,"tag":274,"props":3446,"children":3447},{"style":287},[3448],{"type":50,"value":3449},"node-tls-secre",{"type":45,"tag":274,"props":3451,"children":3452},{"style":443},[3453],{"type":50,"value":3454},"t",{"type":45,"tag":274,"props":3456,"children":3457},{"style":371},[3458],{"type":50,"value":451},{"type":45,"tag":274,"props":3460,"children":3461},{"style":287},[3462],{"type":50,"value":764},{"type":45,"tag":274,"props":3464,"children":3465},{"style":287},[3466],{"type":50,"value":769},{"type":45,"tag":274,"props":3468,"children":3469},{"style":371},[3470],{"type":50,"value":774},{"type":45,"tag":274,"props":3472,"children":3473},{"style":287},[3474],{"type":50,"value":3475},"{.data.tls\\.crt}",{"type":45,"tag":274,"props":3477,"children":3478},{"style":371},[3479],{"type":50,"value":774},{"type":45,"tag":274,"props":3481,"children":3482},{"style":371},[3483],{"type":50,"value":1804},{"type":45,"tag":274,"props":3485,"children":3486},{"style":281},[3487],{"type":50,"value":3488}," base64",{"type":45,"tag":274,"props":3490,"children":3491},{"style":287},[3492],{"type":50,"value":3493}," -d",{"type":45,"tag":274,"props":3495,"children":3496},{"style":371},[3497],{"type":50,"value":1804},{"type":45,"tag":274,"props":3499,"children":3500},{"style":443},[3501],{"type":50,"value":994},{"type":45,"tag":274,"props":3503,"children":3504},{"class":276,"line":501},[3505,3510,3515,3520,3525,3530,3535,3540,3545,3549],{"type":45,"tag":274,"props":3506,"children":3507},{"style":281},[3508],{"type":50,"value":3509}," openssl",{"type":45,"tag":274,"props":3511,"children":3512},{"style":287},[3513],{"type":50,"value":3514}," x509",{"type":45,"tag":274,"props":3516,"children":3517},{"style":287},[3518],{"type":50,"value":3519}," -noout",{"type":45,"tag":274,"props":3521,"children":3522},{"style":287},[3523],{"type":50,"value":3524}," -dates",{"type":45,"tag":274,"props":3526,"children":3527},{"style":287},[3528],{"type":50,"value":3529}," -subject",{"type":45,"tag":274,"props":3531,"children":3532},{"style":287},[3533],{"type":50,"value":3534}," -issuer",{"type":45,"tag":274,"props":3536,"children":3537},{"style":287},[3538],{"type":50,"value":3539}," -ext",{"type":45,"tag":274,"props":3541,"children":3542},{"style":287},[3543],{"type":50,"value":3544}," subjectAltName",{"type":45,"tag":274,"props":3546,"children":3547},{"style":371},[3548],{"type":50,"value":374},{"type":45,"tag":274,"props":3550,"children":3551},{"style":287},[3552],{"type":50,"value":3553}," crdb-operator-escalation\u002Fnode-cert-metadata.txt\n",{"type":45,"tag":53,"props":3555,"children":3556},{},[3557],{"type":50,"value":3558},"Do not collect private key values.",{"type":45,"tag":2492,"props":3560,"children":3562},{"id":3561},"migration",[3563],{"type":50,"value":3564},"Migration",{"type":45,"tag":53,"props":3566,"children":3567},{},[3568,3570,3577,3579,3585],{"type":50,"value":3569},"Use ",{"type":45,"tag":3571,"props":3572,"children":3574},"a",{"href":3573},"..\u002F..\u002Fcockroachdb-onboarding-and-migrations\u002Fdebugging-cockroachdb-operator-migrations\u002FSKILL.md",[3575],{"type":50,"value":3576},"debugging-cockroachdb-operator-migrations",{"type":50,"value":3578}," and attach its migration state output. Include source StatefulSet or v1alpha1 ",{"type":45,"tag":115,"props":3580,"children":3582},{"className":3581},[],[3583],{"type":50,"value":3584},"CrdbCluster",{"type":50,"value":3586},", migration labels, migration phase, source ownerReferences, and migration controller logs.",{"type":45,"tag":59,"props":3588,"children":3590},{"id":3589},"step-5-operator-pprof-and-metrics",[3591],{"type":50,"value":3592},"Step 5: Operator pprof and Metrics",{"type":45,"tag":53,"props":3594,"children":3595},{},[3596],{"type":50,"value":3597},"Collect these when the operator is running but not reconciling, logs\u002Fstatus do not explain why, or a worker may be blocked. In production or restricted environments, confirm with the customer, TSE, or the operator team before opening port-forwards.",{"type":45,"tag":53,"props":3599,"children":3600},{},[3601],{"type":50,"value":3602},"In one terminal:",{"type":45,"tag":263,"props":3604,"children":3606},{"className":265,"code":3605,"language":267,"meta":268,"style":268},"kubectl -n \u003Coperator-namespace> port-forward deployment\u002Fcockroach-operator 7080:7080\n",[3607],{"type":45,"tag":115,"props":3608,"children":3609},{"__ignoreMap":268},[3610],{"type":45,"tag":274,"props":3611,"children":3612},{"class":276,"line":277},[3613,3617,3621,3625,3629,3633,3637,3642,3647],{"type":45,"tag":274,"props":3614,"children":3615},{"style":281},[3616],{"type":50,"value":358},{"type":45,"tag":274,"props":3618,"children":3619},{"style":287},[3620],{"type":50,"value":430},{"type":45,"tag":274,"props":3622,"children":3623},{"style":371},[3624],{"type":50,"value":435},{"type":45,"tag":274,"props":3626,"children":3627},{"style":287},[3628],{"type":50,"value":440},{"type":45,"tag":274,"props":3630,"children":3631},{"style":443},[3632],{"type":50,"value":446},{"type":45,"tag":274,"props":3634,"children":3635},{"style":371},[3636],{"type":50,"value":451},{"type":45,"tag":274,"props":3638,"children":3639},{"style":287},[3640],{"type":50,"value":3641}," port-forward",{"type":45,"tag":274,"props":3643,"children":3644},{"style":287},[3645],{"type":50,"value":3646}," deployment\u002Fcockroach-operator",{"type":45,"tag":274,"props":3648,"children":3649},{"style":287},[3650],{"type":50,"value":3651}," 7080:7080\n",{"type":45,"tag":53,"props":3653,"children":3654},{},[3655],{"type":50,"value":3656},"In another terminal:",{"type":45,"tag":263,"props":3658,"children":3660},{"className":265,"code":3659,"language":267,"meta":268,"style":268},"curl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fgoroutine?debug=2' > crdb-operator-escalation\u002Fgoroutine_dump.txt\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fgoroutine?debug=1' > crdb-operator-escalation\u002Fgoroutine_summary.txt\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fheap' > crdb-operator-escalation\u002Fheap.prof\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fprofile?seconds=30' > crdb-operator-escalation\u002Fcpu.prof\ncurl -s 'http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fmutex' > crdb-operator-escalation\u002Fmutex.prof\n",[3661],{"type":45,"tag":115,"props":3662,"children":3663},{"__ignoreMap":268},[3664,3699,3732,3765,3798],{"type":45,"tag":274,"props":3665,"children":3666},{"class":276,"line":277},[3667,3672,3677,3681,3686,3690,3694],{"type":45,"tag":274,"props":3668,"children":3669},{"style":281},[3670],{"type":50,"value":3671},"curl",{"type":45,"tag":274,"props":3673,"children":3674},{"style":287},[3675],{"type":50,"value":3676}," -s",{"type":45,"tag":274,"props":3678,"children":3679},{"style":371},[3680],{"type":50,"value":1814},{"type":45,"tag":274,"props":3682,"children":3683},{"style":287},[3684],{"type":50,"value":3685},"http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fgoroutine?debug=2",{"type":45,"tag":274,"props":3687,"children":3688},{"style":371},[3689],{"type":50,"value":774},{"type":45,"tag":274,"props":3691,"children":3692},{"style":371},[3693],{"type":50,"value":374},{"type":45,"tag":274,"props":3695,"children":3696},{"style":287},[3697],{"type":50,"value":3698}," crdb-operator-escalation\u002Fgoroutine_dump.txt\n",{"type":45,"tag":274,"props":3700,"children":3701},{"class":276,"line":382},[3702,3706,3710,3714,3719,3723,3727],{"type":45,"tag":274,"props":3703,"children":3704},{"style":281},[3705],{"type":50,"value":3671},{"type":45,"tag":274,"props":3707,"children":3708},{"style":287},[3709],{"type":50,"value":3676},{"type":45,"tag":274,"props":3711,"children":3712},{"style":371},[3713],{"type":50,"value":1814},{"type":45,"tag":274,"props":3715,"children":3716},{"style":287},[3717],{"type":50,"value":3718},"http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fgoroutine?debug=1",{"type":45,"tag":274,"props":3720,"children":3721},{"style":371},[3722],{"type":50,"value":774},{"type":45,"tag":274,"props":3724,"children":3725},{"style":371},[3726],{"type":50,"value":374},{"type":45,"tag":274,"props":3728,"children":3729},{"style":287},[3730],{"type":50,"value":3731}," crdb-operator-escalation\u002Fgoroutine_summary.txt\n",{"type":45,"tag":274,"props":3733,"children":3734},{"class":276,"line":409},[3735,3739,3743,3747,3752,3756,3760],{"type":45,"tag":274,"props":3736,"children":3737},{"style":281},[3738],{"type":50,"value":3671},{"type":45,"tag":274,"props":3740,"children":3741},{"style":287},[3742],{"type":50,"value":3676},{"type":45,"tag":274,"props":3744,"children":3745},{"style":371},[3746],{"type":50,"value":1814},{"type":45,"tag":274,"props":3748,"children":3749},{"style":287},[3750],{"type":50,"value":3751},"http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fheap",{"type":45,"tag":274,"props":3753,"children":3754},{"style":371},[3755],{"type":50,"value":774},{"type":45,"tag":274,"props":3757,"children":3758},{"style":371},[3759],{"type":50,"value":374},{"type":45,"tag":274,"props":3761,"children":3762},{"style":287},[3763],{"type":50,"value":3764}," crdb-operator-escalation\u002Fheap.prof\n",{"type":45,"tag":274,"props":3766,"children":3767},{"class":276,"line":419},[3768,3772,3776,3780,3785,3789,3793],{"type":45,"tag":274,"props":3769,"children":3770},{"style":281},[3771],{"type":50,"value":3671},{"type":45,"tag":274,"props":3773,"children":3774},{"style":287},[3775],{"type":50,"value":3676},{"type":45,"tag":274,"props":3777,"children":3778},{"style":371},[3779],{"type":50,"value":1814},{"type":45,"tag":274,"props":3781,"children":3782},{"style":287},[3783],{"type":50,"value":3784},"http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fprofile?seconds=30",{"type":45,"tag":274,"props":3786,"children":3787},{"style":371},[3788],{"type":50,"value":774},{"type":45,"tag":274,"props":3790,"children":3791},{"style":371},[3792],{"type":50,"value":374},{"type":45,"tag":274,"props":3794,"children":3795},{"style":287},[3796],{"type":50,"value":3797}," crdb-operator-escalation\u002Fcpu.prof\n",{"type":45,"tag":274,"props":3799,"children":3800},{"class":276,"line":501},[3801,3805,3809,3813,3818,3822,3826],{"type":45,"tag":274,"props":3802,"children":3803},{"style":281},[3804],{"type":50,"value":3671},{"type":45,"tag":274,"props":3806,"children":3807},{"style":287},[3808],{"type":50,"value":3676},{"type":45,"tag":274,"props":3810,"children":3811},{"style":371},[3812],{"type":50,"value":1814},{"type":45,"tag":274,"props":3814,"children":3815},{"style":287},[3816],{"type":50,"value":3817},"http:\u002F\u002Flocalhost:7080\u002Fdebug\u002Fpprof\u002Fmutex",{"type":45,"tag":274,"props":3819,"children":3820},{"style":371},[3821],{"type":50,"value":774},{"type":45,"tag":274,"props":3823,"children":3824},{"style":371},[3825],{"type":50,"value":374},{"type":45,"tag":274,"props":3827,"children":3828},{"style":287},[3829],{"type":50,"value":3830}," crdb-operator-escalation\u002Fmutex.prof\n",{"type":45,"tag":53,"props":3832,"children":3833},{},[3834],{"type":50,"value":3835},"Metrics:",{"type":45,"tag":263,"props":3837,"children":3839},{"className":265,"code":3838,"language":267,"meta":268,"style":268},"kubectl -n \u003Coperator-namespace> port-forward deployment\u002Fcockroach-operator 8080:8080\ncurl -s http:\u002F\u002Flocalhost:8080\u002Fmetrics > crdb-operator-escalation\u002Fmetrics_dump.txt\ngrep 'controller_runtime_reconcile_total' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Freconcile-total.txt || true\ngrep 'controller_runtime_reconcile_errors_total' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Freconcile-errors.txt || true\ngrep 'workqueue_depth' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Fworkqueue-depth.txt || true\ngrep 'workqueue_longest_running_processor_seconds' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Fworkqueue-longest-running.txt || true\ngrep 'workqueue_unfinished_work_seconds' crdb-operator-escalation\u002Fmetrics_dump.txt > crdb-operator-escalation\u002Fworkqueue-unfinished.txt || true\n",[3840],{"type":45,"tag":115,"props":3841,"children":3842},{"__ignoreMap":268},[3843,3883,3908,3951,3992,4033,4074],{"type":45,"tag":274,"props":3844,"children":3845},{"class":276,"line":277},[3846,3850,3854,3858,3862,3866,3870,3874,3878],{"type":45,"tag":274,"props":3847,"children":3848},{"style":281},[3849],{"type":50,"value":358},{"type":45,"tag":274,"props":3851,"children":3852},{"style":287},[3853],{"type":50,"value":430},{"type":45,"tag":274,"props":3855,"children":3856},{"style":371},[3857],{"type":50,"value":435},{"type":45,"tag":274,"props":3859,"children":3860},{"style":287},[3861],{"type":50,"value":440},{"type":45,"tag":274,"props":3863,"children":3864},{"style":443},[3865],{"type":50,"value":446},{"type":45,"tag":274,"props":3867,"children":3868},{"style":371},[3869],{"type":50,"value":451},{"type":45,"tag":274,"props":3871,"children":3872},{"style":287},[3873],{"type":50,"value":3641},{"type":45,"tag":274,"props":3875,"children":3876},{"style":287},[3877],{"type":50,"value":3646},{"type":45,"tag":274,"props":3879,"children":3880},{"style":287},[3881],{"type":50,"value":3882}," 8080:8080\n",{"type":45,"tag":274,"props":3884,"children":3885},{"class":276,"line":382},[3886,3890,3894,3899,3903],{"type":45,"tag":274,"props":3887,"children":3888},{"style":281},[3889],{"type":50,"value":3671},{"type":45,"tag":274,"props":3891,"children":3892},{"style":287},[3893],{"type":50,"value":3676},{"type":45,"tag":274,"props":3895,"children":3896},{"style":287},[3897],{"type":50,"value":3898}," http:\u002F\u002Flocalhost:8080\u002Fmetrics",{"type":45,"tag":274,"props":3900,"children":3901},{"style":371},[3902],{"type":50,"value":374},{"type":45,"tag":274,"props":3904,"children":3905},{"style":287},[3906],{"type":50,"value":3907}," crdb-operator-escalation\u002Fmetrics_dump.txt\n",{"type":45,"tag":274,"props":3909,"children":3910},{"class":276,"line":409},[3911,3916,3920,3925,3929,3934,3938,3943,3947],{"type":45,"tag":274,"props":3912,"children":3913},{"style":281},[3914],{"type":50,"value":3915},"grep",{"type":45,"tag":274,"props":3917,"children":3918},{"style":371},[3919],{"type":50,"value":1814},{"type":45,"tag":274,"props":3921,"children":3922},{"style":287},[3923],{"type":50,"value":3924},"controller_runtime_reconcile_total",{"type":45,"tag":274,"props":3926,"children":3927},{"style":371},[3928],{"type":50,"value":774},{"type":45,"tag":274,"props":3930,"children":3931},{"style":287},[3932],{"type":50,"value":3933}," crdb-operator-escalation\u002Fmetrics_dump.txt",{"type":45,"tag":274,"props":3935,"children":3936},{"style":371},[3937],{"type":50,"value":374},{"type":45,"tag":274,"props":3939,"children":3940},{"style":287},[3941],{"type":50,"value":3942}," crdb-operator-escalation\u002Freconcile-total.txt",{"type":45,"tag":274,"props":3944,"children":3945},{"style":371},[3946],{"type":50,"value":492},{"type":45,"tag":274,"props":3948,"children":3949},{"style":495},[3950],{"type":50,"value":498},{"type":45,"tag":274,"props":3952,"children":3953},{"class":276,"line":419},[3954,3958,3962,3967,3971,3975,3979,3984,3988],{"type":45,"tag":274,"props":3955,"children":3956},{"style":281},[3957],{"type":50,"value":3915},{"type":45,"tag":274,"props":3959,"children":3960},{"style":371},[3961],{"type":50,"value":1814},{"type":45,"tag":274,"props":3963,"children":3964},{"style":287},[3965],{"type":50,"value":3966},"controller_runtime_reconcile_errors_total",{"type":45,"tag":274,"props":3968,"children":3969},{"style":371},[3970],{"type":50,"value":774},{"type":45,"tag":274,"props":3972,"children":3973},{"style":287},[3974],{"type":50,"value":3933},{"type":45,"tag":274,"props":3976,"children":3977},{"style":371},[3978],{"type":50,"value":374},{"type":45,"tag":274,"props":3980,"children":3981},{"style":287},[3982],{"type":50,"value":3983}," crdb-operator-escalation\u002Freconcile-errors.txt",{"type":45,"tag":274,"props":3985,"children":3986},{"style":371},[3987],{"type":50,"value":492},{"type":45,"tag":274,"props":3989,"children":3990},{"style":495},[3991],{"type":50,"value":498},{"type":45,"tag":274,"props":3993,"children":3994},{"class":276,"line":501},[3995,3999,4003,4008,4012,4016,4020,4025,4029],{"type":45,"tag":274,"props":3996,"children":3997},{"style":281},[3998],{"type":50,"value":3915},{"type":45,"tag":274,"props":4000,"children":4001},{"style":371},[4002],{"type":50,"value":1814},{"type":45,"tag":274,"props":4004,"children":4005},{"style":287},[4006],{"type":50,"value":4007},"workqueue_depth",{"type":45,"tag":274,"props":4009,"children":4010},{"style":371},[4011],{"type":50,"value":774},{"type":45,"tag":274,"props":4013,"children":4014},{"style":287},[4015],{"type":50,"value":3933},{"type":45,"tag":274,"props":4017,"children":4018},{"style":371},[4019],{"type":50,"value":374},{"type":45,"tag":274,"props":4021,"children":4022},{"style":287},[4023],{"type":50,"value":4024}," crdb-operator-escalation\u002Fworkqueue-depth.txt",{"type":45,"tag":274,"props":4026,"children":4027},{"style":371},[4028],{"type":50,"value":492},{"type":45,"tag":274,"props":4030,"children":4031},{"style":495},[4032],{"type":50,"value":498},{"type":45,"tag":274,"props":4034,"children":4035},{"class":276,"line":571},[4036,4040,4044,4049,4053,4057,4061,4066,4070],{"type":45,"tag":274,"props":4037,"children":4038},{"style":281},[4039],{"type":50,"value":3915},{"type":45,"tag":274,"props":4041,"children":4042},{"style":371},[4043],{"type":50,"value":1814},{"type":45,"tag":274,"props":4045,"children":4046},{"style":287},[4047],{"type":50,"value":4048},"workqueue_longest_running_processor_seconds",{"type":45,"tag":274,"props":4050,"children":4051},{"style":371},[4052],{"type":50,"value":774},{"type":45,"tag":274,"props":4054,"children":4055},{"style":287},[4056],{"type":50,"value":3933},{"type":45,"tag":274,"props":4058,"children":4059},{"style":371},[4060],{"type":50,"value":374},{"type":45,"tag":274,"props":4062,"children":4063},{"style":287},[4064],{"type":50,"value":4065}," crdb-operator-escalation\u002Fworkqueue-longest-running.txt",{"type":45,"tag":274,"props":4067,"children":4068},{"style":371},[4069],{"type":50,"value":492},{"type":45,"tag":274,"props":4071,"children":4072},{"style":495},[4073],{"type":50,"value":498},{"type":45,"tag":274,"props":4075,"children":4076},{"class":276,"line":642},[4077,4081,4085,4090,4094,4098,4102,4107,4111],{"type":45,"tag":274,"props":4078,"children":4079},{"style":281},[4080],{"type":50,"value":3915},{"type":45,"tag":274,"props":4082,"children":4083},{"style":371},[4084],{"type":50,"value":1814},{"type":45,"tag":274,"props":4086,"children":4087},{"style":287},[4088],{"type":50,"value":4089},"workqueue_unfinished_work_seconds",{"type":45,"tag":274,"props":4091,"children":4092},{"style":371},[4093],{"type":50,"value":774},{"type":45,"tag":274,"props":4095,"children":4096},{"style":287},[4097],{"type":50,"value":3933},{"type":45,"tag":274,"props":4099,"children":4100},{"style":371},[4101],{"type":50,"value":374},{"type":45,"tag":274,"props":4103,"children":4104},{"style":287},[4105],{"type":50,"value":4106}," crdb-operator-escalation\u002Fworkqueue-unfinished.txt",{"type":45,"tag":274,"props":4108,"children":4109},{"style":371},[4110],{"type":50,"value":492},{"type":45,"tag":274,"props":4112,"children":4113},{"style":495},[4114],{"type":50,"value":498},{"type":45,"tag":53,"props":4116,"children":4117},{},[4118],{"type":50,"value":4119},"What TSC should inspect:",{"type":45,"tag":66,"props":4121,"children":4122},{},[4123,4147,4164,4174,4184],{"type":45,"tag":70,"props":4124,"children":4125},{},[4126,4132,4134,4140,4142],{"type":45,"tag":115,"props":4127,"children":4129},{"className":4128},[],[4130],{"type":50,"value":4131},"processNextWorkItem",{"type":50,"value":4133}," followed by ",{"type":45,"tag":115,"props":4135,"children":4137},{"className":4136},[],[4138],{"type":50,"value":4139},"Reconcile",{"type":50,"value":4141}," and a long-running call in ",{"type":45,"tag":115,"props":4143,"children":4145},{"className":4144},[],[4146],{"type":50,"value":328},{"type":45,"tag":70,"props":4148,"children":4149},{},[4150,4156,4157,4162],{"type":45,"tag":115,"props":4151,"children":4153},{"className":4152},[],[4154],{"type":50,"value":4155},"kube.(*Ctl).Exec",{"type":50,"value":308},{"type":45,"tag":115,"props":4158,"children":4160},{"className":4159},[],[4161],{"type":50,"value":151},{"type":50,"value":4163},", HTTP calls, or mutex waits with long durations",{"type":45,"tag":70,"props":4165,"children":4166},{},[4167,4169],{"type":50,"value":4168},"increasing ",{"type":45,"tag":115,"props":4170,"children":4172},{"className":4171},[],[4173],{"type":50,"value":4048},{"type":45,"tag":70,"props":4175,"children":4176},{},[4177,4179],{"type":50,"value":4178},"growing ",{"type":45,"tag":115,"props":4180,"children":4182},{"className":4181},[],[4183],{"type":50,"value":4007},{"type":45,"tag":70,"props":4185,"children":4186},{},[4187],{"type":50,"value":4188},"no reconcile count movement for a controller that should be active",{"type":45,"tag":59,"props":4190,"children":4192},{"id":4191},"step-6-timeline",[4193],{"type":50,"value":4194},"Step 6: Timeline",{"type":45,"tag":53,"props":4196,"children":4197},{},[4198,4200,4206],{"type":50,"value":4199},"Create ",{"type":45,"tag":115,"props":4201,"children":4203},{"className":4202},[],[4204],{"type":50,"value":4205},"crdb-operator-escalation\u002Ftimeline.md",{"type":50,"value":4207}," with:",{"type":45,"tag":66,"props":4209,"children":4210},{},[4211,4216,4221,4226,4231,4236,4241],{"type":45,"tag":70,"props":4212,"children":4213},{},[4214],{"type":50,"value":4215},"When the issue started",{"type":45,"tag":70,"props":4217,"children":4218},{},[4219],{"type":50,"value":4220},"What operation was in progress",{"type":45,"tag":70,"props":4222,"children":4223},{},[4224],{"type":50,"value":4225},"What docs or runbooks were followed",{"type":45,"tag":70,"props":4227,"children":4228},{},[4229],{"type":50,"value":4230},"Whether VMs, Kubernetes nodes, disks, storage classes, certs, network policies, or Helm values changed",{"type":45,"tag":70,"props":4232,"children":4233},{},[4234],{"type":50,"value":4235},"Every manual delete, patch, edit, restart, drain, decommission, or Helm command, in order",{"type":45,"tag":70,"props":4237,"children":4238},{},[4239],{"type":50,"value":4240},"What is currently serving traffic and what is unavailable",{"type":45,"tag":70,"props":4242,"children":4243},{},[4244],{"type":50,"value":4245},"Customer restrictions, such as no cluster-admin, no debug containers, no external images, or private registry only",{"type":45,"tag":59,"props":4247,"children":4249},{"id":4248},"step-7-escalation-summary",[4250],{"type":50,"value":4251},"Step 7: Escalation Summary",{"type":45,"tag":53,"props":4253,"children":4254},{},[4255],{"type":50,"value":4256},"Return a concise summary with:",{"type":45,"tag":4258,"props":4259,"children":4260},"ol",{},[4261,4266,4271,4283,4288,4293,4298],{"type":45,"tag":70,"props":4262,"children":4263},{},[4264],{"type":50,"value":4265},"Operation type and current impact",{"type":45,"tag":70,"props":4267,"children":4268},{},[4269],{"type":50,"value":4270},"Current operator and CockroachDB versions",{"type":45,"tag":70,"props":4272,"children":4273},{},[4274,4276,4281],{"type":50,"value":4275},"Current ",{"type":45,"tag":115,"props":4277,"children":4279},{"className":4278},[],[4280],{"type":50,"value":3584},{"type":50,"value":4282}," mode, generation, observedGeneration, status image, and actions",{"type":45,"tag":70,"props":4284,"children":4285},{},[4286],{"type":50,"value":4287},"Stuck resource or symptom",{"type":45,"tag":70,"props":4289,"children":4290},{},[4291],{"type":50,"value":4292},"Any unsafe operations already performed",{"type":45,"tag":70,"props":4294,"children":4295},{},[4296],{"type":50,"value":4297},"Missing artifacts, if any",{"type":45,"tag":70,"props":4299,"children":4300},{},[4301],{"type":50,"value":4302},"Whether pprof\u002Fmetrics suggest a blocked worker",{"type":45,"tag":59,"props":4304,"children":4306},{"id":4305},"references",[4307],{"type":50,"value":4308},"References",{"type":45,"tag":66,"props":4310,"children":4311},{},[4312,4321,4328],{"type":45,"tag":70,"props":4313,"children":4314},{},[4315],{"type":45,"tag":3571,"props":4316,"children":4318},{"href":4317},"..\u002Fdiagnosing-cockroachdb-helm-deployments\u002FSKILL.md",[4319],{"type":50,"value":4320},"diagnosing-cockroachdb-helm-deployments",{"type":45,"tag":70,"props":4322,"children":4323},{},[4324],{"type":45,"tag":3571,"props":4325,"children":4326},{"href":3573},[4327],{"type":50,"value":3576},{"type":45,"tag":70,"props":4329,"children":4330},{},[4331],{"type":45,"tag":3571,"props":4332,"children":4334},{"href":4333},"..\u002F..\u002F..\u002FCHANGELOG.md",[4335],{"type":50,"value":4336},"CockroachDB Helm Chart Changelog",{"type":45,"tag":4338,"props":4339,"children":4340},"style",{},[4341],{"type":50,"value":4342},"html .light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html.light .shiki span {color: var(--shiki-light);background: var(--shiki-light-bg);font-style: var(--shiki-light-font-style);font-weight: var(--shiki-light-font-weight);text-decoration: var(--shiki-light-text-decoration);}html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"items":4344,"total":571},[4345,4352,4368,4380,4390,4400],{"slug":4,"name":4,"fn":5,"description":6,"org":4346,"tags":4347,"stars":25,"repoUrl":26,"updatedAt":27},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4348,4349,4350,4351],{"name":20,"slug":21,"type":15},{"name":17,"slug":18,"type":15},{"name":23,"slug":24,"type":15},{"name":13,"slug":14,"type":15},{"slug":4353,"name":4353,"fn":4354,"description":4355,"org":4356,"tags":4357,"stars":25,"repoUrl":26,"updatedAt":4367},"configuring-cockroachdb-helm-tls","configure TLS for CockroachDB Helm charts","Selects and validates TLS settings for CockroachDB Helm chart deployments, including self-signer, cert-manager, and external certificate modes. Use when a customer needs secure CockroachDB Helm values, certificate secret mapping, cert-manager integration, or TLS install troubleshooting before deploying the chart.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4358,4361,4364],{"name":4359,"slug":4360,"type":15},"Deployment","deployment",{"name":4362,"slug":4363,"type":15},"Encryption","encryption",{"name":4365,"slug":4366,"type":15},"Security","security","2026-07-12T07:56:37.675396",{"slug":3576,"name":3576,"fn":4369,"description":4370,"org":4371,"tags":4372,"stars":25,"repoUrl":26,"updatedAt":4379},"debug CockroachDB Operator migration scenarios","Debugs CockroachDB Operator migration scenarios, including Helm StatefulSet to v1beta1 CrdbNode migration and public operator v1alpha1 to v1beta1 migration. Use when migration labels, migration phases, source StatefulSet ownership, converted CRDs, PVC ownership, or post-migration reconciliation are unclear or stuck.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4373,4374,4377,4378],{"name":20,"slug":21,"type":15},{"name":4375,"slug":4376,"type":15},"Debugging","debugging",{"name":23,"slug":24,"type":15},{"name":3564,"slug":3561,"type":15},"2026-07-12T07:56:48.360871",{"slug":4320,"name":4320,"fn":4381,"description":4382,"org":4383,"tags":4384,"stars":25,"repoUrl":26,"updatedAt":4389},"diagnose CockroachDB Helm chart deployments","Diagnoses failed or unhealthy CockroachDB Helm chart deployments by checking Helm release state, operator health, CrdbCluster and CrdbNode status, pod readiness, RBAC, webhooks, TLS, upgrades, scaling, PVCs, DNS, and multi-region assumptions. Use when Helm install or upgrade fails, pods are not Ready, or the operator is not reconciling.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4385,4386,4387,4388],{"name":20,"slug":21,"type":15},{"name":4375,"slug":4376,"type":15},{"name":4359,"slug":4360,"type":15},{"name":23,"slug":24,"type":15},"2026-07-12T07:57:24.018818",{"slug":4391,"name":4391,"fn":4392,"description":4393,"org":4394,"tags":4395,"stars":25,"repoUrl":26,"updatedAt":4399},"installing-cockroachdb-with-helm","install CockroachDB using Helm","Guides customer-facing installation of CockroachDB on Kubernetes using the CockroachDB split Helm charts and operator-managed v1beta1 resources. Use when installing CockroachDB with Helm, choosing between published and local split charts, verifying a new install, or helping an agent complete first-time Kubernetes onboarding.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4396,4397,4398],{"name":20,"slug":21,"type":15},{"name":4359,"slug":4360,"type":15},{"name":23,"slug":24,"type":15},"2026-07-12T07:56:45.777567",{"slug":4401,"name":4401,"fn":4402,"description":4403,"org":4404,"tags":4405,"stars":25,"repoUrl":26,"updatedAt":4412},"validating-cockroachdb-helm-multiregion","validate CockroachDB multi-region Helm deployments","Validates CockroachDB Helm chart values and Kubernetes prerequisites for operator-managed multi-region deployments. Use before adding a region, deploying CockroachDB across multiple Kubernetes clusters, checking region DNS domains, or confirming that all regions share certificate and networking assumptions.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4406,4407,4408,4409],{"name":20,"slug":21,"type":15},{"name":4359,"slug":4360,"type":15},{"name":23,"slug":24,"type":15},{"name":4410,"slug":4411,"type":15},"Operations","operations","2026-07-12T07:56:47.082609",{"items":4414,"total":4535},[4415,4422,4428,4435,4442,4448,4455,4468,4483,4498,4509,4522],{"slug":4,"name":4,"fn":5,"description":6,"org":4416,"tags":4417,"stars":25,"repoUrl":26,"updatedAt":27},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4418,4419,4420,4421],{"name":20,"slug":21,"type":15},{"name":17,"slug":18,"type":15},{"name":23,"slug":24,"type":15},{"name":13,"slug":14,"type":15},{"slug":4353,"name":4353,"fn":4354,"description":4355,"org":4423,"tags":4424,"stars":25,"repoUrl":26,"updatedAt":4367},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4425,4426,4427],{"name":4359,"slug":4360,"type":15},{"name":4362,"slug":4363,"type":15},{"name":4365,"slug":4366,"type":15},{"slug":3576,"name":3576,"fn":4369,"description":4370,"org":4429,"tags":4430,"stars":25,"repoUrl":26,"updatedAt":4379},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4431,4432,4433,4434],{"name":20,"slug":21,"type":15},{"name":4375,"slug":4376,"type":15},{"name":23,"slug":24,"type":15},{"name":3564,"slug":3561,"type":15},{"slug":4320,"name":4320,"fn":4381,"description":4382,"org":4436,"tags":4437,"stars":25,"repoUrl":26,"updatedAt":4389},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4438,4439,4440,4441],{"name":20,"slug":21,"type":15},{"name":4375,"slug":4376,"type":15},{"name":4359,"slug":4360,"type":15},{"name":23,"slug":24,"type":15},{"slug":4391,"name":4391,"fn":4392,"description":4393,"org":4443,"tags":4444,"stars":25,"repoUrl":26,"updatedAt":4399},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4445,4446,4447],{"name":20,"slug":21,"type":15},{"name":4359,"slug":4360,"type":15},{"name":23,"slug":24,"type":15},{"slug":4401,"name":4401,"fn":4402,"description":4403,"org":4449,"tags":4450,"stars":25,"repoUrl":26,"updatedAt":4412},{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4451,4452,4453,4454],{"name":20,"slug":21,"type":15},{"name":4359,"slug":4360,"type":15},{"name":23,"slug":24,"type":15},{"name":4410,"slug":4411,"type":15},{"slug":4456,"name":4456,"fn":4457,"description":4458,"org":4459,"tags":4460,"stars":409,"repoUrl":4466,"updatedAt":4467},"analyzing-range-distribution","analyze CockroachDB range distribution and health","Analyzes CockroachDB range distribution across tables and indexes using SHOW RANGES to identify range count, size patterns, leaseholder placement, and replication health. Use when investigating hotspots, uneven data distribution, range fragmentation, or validating zone configuration effects without DB Console access.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4461,4462,4463],{"name":20,"slug":21,"type":15},{"name":13,"slug":14,"type":15},{"name":4464,"slug":4465,"type":15},"Performance","performance","https:\u002F\u002Fgithub.com\u002Fcockroachdb\u002Fclaude-plugin","2026-07-12T07:57:18.753533",{"slug":4469,"name":4469,"fn":4470,"description":4471,"org":4472,"tags":4473,"stars":409,"repoUrl":4466,"updatedAt":4482},"analyzing-schema-change-storage-risk","analyze schema change storage requirements","Estimates storage requirements for CockroachDB online schema change backfills using SHOW RANGES WITH DETAILS, KEYS, INDEXES. Use before CREATE INDEX, ADD COLUMN with INDEX\u002FUNIQUE, ALTER PRIMARY KEY, CREATE MATERIALIZED VIEW, CREATE TABLE AS, REFRESH, or SET LOCALITY on tables with large per-index footprints, to avoid mid-backfill disk exhaustion.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4474,4477,4478,4479],{"name":4475,"slug":4476,"type":15},"Data Modeling","data-modeling",{"name":20,"slug":21,"type":15},{"name":4464,"slug":4465,"type":15},{"name":4480,"slug":4481,"type":15},"SQL","sql","2026-07-12T07:57:22.763788",{"slug":4484,"name":4484,"fn":4485,"description":4486,"org":4487,"tags":4488,"stars":409,"repoUrl":4466,"updatedAt":4497},"auditing-cis-benchmark","audit CockroachDB clusters against CIS benchmarks","Audits a self-hosted CockroachDB cluster against the CIS CockroachDB Benchmark v1.0.0 Level 1 controls. Supports two audit depths — quick automated scans and full CIS audit procedures. Produces a structured PASS\u002FFAIL\u002FMANUAL report covering installation, system hardening, logging, user access, data protection, and CockroachDB settings. Use when preparing for CIS compliance assessments, hardening self-hosted deployments, or validating security posture against industry benchmarks.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4489,4492,4495,4496],{"name":4490,"slug":4491,"type":15},"Audit","audit",{"name":4493,"slug":4494,"type":15},"Compliance","compliance",{"name":20,"slug":21,"type":15},{"name":4365,"slug":4366,"type":15},"2026-07-18T05:48:00.862384",{"slug":4499,"name":4499,"fn":4500,"description":4501,"org":4502,"tags":4503,"stars":409,"repoUrl":4466,"updatedAt":4508},"auditing-cloud-cluster-security","audit CockroachDB cluster security posture","Audits the security posture of a CockroachDB cluster (Cloud or self-hosted) across network, authentication, authorization, encryption, audit logging, and backup dimensions. Use when assessing cluster security readiness, preparing for compliance reviews, or investigating security configuration gaps.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4504,4505,4506,4507],{"name":4490,"slug":4491,"type":15},{"name":20,"slug":21,"type":15},{"name":4410,"slug":4411,"type":15},{"name":4365,"slug":4366,"type":15},"2026-07-12T07:57:01.506735",{"slug":4510,"name":4510,"fn":4511,"description":4512,"org":4513,"tags":4514,"stars":409,"repoUrl":4466,"updatedAt":4521},"auditing-table-statistics","audit optimizer table statistics","Audits optimizer table statistics for staleness, missing coverage, and data quality issues using SHOW STATISTICS. Use when diagnosing poor query performance, unexpected plan changes, or after bulk data changes to identify stale statistics requiring refresh via CREATE STATISTICS.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4515,4516,4519,4520],{"name":4490,"slug":4491,"type":15},{"name":4517,"slug":4518,"type":15},"Data Analysis","data-analysis",{"name":20,"slug":21,"type":15},{"name":4464,"slug":4465,"type":15},"2026-07-12T07:57:16.190081",{"slug":4523,"name":4523,"fn":4524,"description":4525,"org":4526,"tags":4527,"stars":409,"repoUrl":4466,"updatedAt":4534},"benchmarking-transaction-patterns","benchmark CockroachDB transaction patterns","Guides benchmarking and comparing explicit multi-statement transactions versus single-statement CTE transactions in CockroachDB, with fair test methodology, contention analysis, and performance interpretation. Use when comparing transaction formulations, benchmarking CockroachDB workloads under contention, investigating retry pressure, or deciding whether to rewrite multi-step application flows into single SQL statements.",{"slug":8,"name":9,"logoUrl":10,"githubOrg":8},[4528,4529,4532,4533],{"name":20,"slug":21,"type":15},{"name":4530,"slug":4531,"type":15},"Engineering","engineering",{"name":4464,"slug":4465,"type":15},{"name":4480,"slug":4481,"type":15},"2026-07-12T07:57:26.543278",40]