
Description
Open-code Phoenix spans with PXI-owned notes, recover those notes for axial coding, and promote stable categories into structured annotations. Load this when analyzing spans to discover failure patterns before a taxonomy exists.
SKILL.md
Span Coding
Open coding is the exploratory pass: inspect individual spans and write short, evidence-close notes about concrete behaviors before deciding what the categories are. Axial coding is the synthesis pass: recover those notes, group recurring patterns, name actionable categories, and promote stable categories into structured annotations.
The unit of analysis is always the span. Inspect spans first, avoid taxonomy labels while collecting open notes, and only write structured annotations after the categories have stabilized.
Source of Truth
PXI span notes in Phoenix are the durable source of truth for open codes.
- Write open codes with
write_span_note. write_span_notealways uses identifierpxi.- Each span has at most one current PXI open-coding note; repeated writes update it.
- The tool is server-executed and does not require approval.
The virtual bash filesystem is scratch space, not the canonical note store. Use files under
/home/user/workspace/.pxi/coding/ for sampled span lists, interim memos, grouping tables,
or draft axial categories when that helps the analysis. Do not dual-write every note to a
file by default; recover durable notes from Phoenix when you need to resume.
Open Coding
- Use the
phoenix-graphqlskill andphoenix-gqlto inspect spans and surrounding trace context. - Read the span input, output, status, attributes, exceptions, and nearby parent/child spans before writing.
- If the span shows a concrete failure or notable behavior, call
write_span_notewith:{"spanId": "<16-char OTel span id>", "note": "<specific observation>"} - Write what you saw, not the category you think it belongs to. Good notes cite the observed behavior: "Retriever returned onboarding docs for a cancellation question." Weak notes jump straight to categories: "retrieval_failure".
- Skip correct spans. Open coding is a signal-building pass, not a requirement to annotate every span.
Do not use batch_span_annotate during open coding unless the user has already supplied a
stable rubric. Free-form PXI notes come first; structured annotation comes later.
Recover PXI Span Notes
Recover PXI notes with a GraphQL query over Project.spans, then filter spanNotes locally
to identifier == "pxi". There is no list_span_notes tool.
query RecoverPxiSpanNotes($projectId: ID!, $first: Int = 50, $after: String) {
node(id: $projectId) {
... on Project {
spans(first: $first, after: $after) {
edges {
node {
spanId
name
trace { traceId }
spanNotes {
identifier
explanation
createdAt
updatedAt
}
}
}
pageInfo {
hasNextPage
endCursor
}
}
}
}
}
Paginate until hasNextPage is false or the recovered sample is sufficient. Keep only notes
whose identifier is exactly pxi. When a span has no PXI note, treat it as uncoded.
Axial Coding
Use recovered PXI notes as the raw material for axial coding.
- Group notes that describe the same underlying failure.
- Name categories for likely causes or fixes, not generic symptoms.
- Check project annotation configs before creating new structured labels.
- Use
batch_span_annotateonly after the categories and labels stabilize. - Keep optional bash sidecars focused on analysis handoff: grouping tables, current counts, and draft taxonomies. The DB notes remain the durable open-coding record.
More skills from the phoenix repository
View all 8 skillsannotate-spans
annotate LLM spans and traces
Jul 12EvalsLLMObservabilityTracingdatasets
reason about Phoenix dataset structure
Jul 12Data AnalysisDatasetsEvalsdebug-trace
diagnose failures using trace investigation
Jul 12DebuggingObservabilityTracingevaluators
author and refine Phoenix evaluators
Jul 12EvalsLLMTestingexperiments
run and compare dataset-backed experiments
Jul 12DatasetsEvalsLLMTestingphoenix-graphql
query Phoenix API with GraphQL
Jul 12AnalyticsData AnalysisGraphQL
More from Arize AI
View publisherplayground
author and iterate on prompts in Phoenix
phoenix
Jul 12EvalsLLMTestingarize-admin
manage Arize enterprise user access
arize-skills
Jul 22CLIOperationsPermissionsarize-ai-provider-integration
manage Arize AI provider integrations
arize-skills
Jul 22AnthropicAzureIntegrationsLLM +1arize-annotation
manage Arize annotation workflows
arize-skills
Jul 22Data AnalysisLLMObservabilityarize-compliance-audit
audit AI agents for regulatory compliance
arize-skills
Jul 19AuditComplianceGDPRLegal +1