Description
AI-powered autonomous data extraction that navigates complex sites and returns structured JSON. Use this skill when the user wants structured data from websites, needs to extract pricing tiers, product listings, directory entries, or any data as JSON with a schema. Triggers on "extract structured data", "get all the products", "pull pricing info", "extract as JSON", or when the user provides a JSON schema for website data. More powerful than simple scraping for multi-page structured extraction.
SKILL.md
firecrawl agent
AI-powered autonomous extraction. The agent navigates sites and extracts structured data (takes 2-5 minutes).
When to use
- You need structured data from complex multi-page sites
- Manual scraping would require navigating many pages
- You want the AI to figure out where the data lives
Quick start
# Extract structured data
firecrawl agent "extract all pricing tiers" --wait -o .firecrawl/pricing.json
# With a JSON schema for structured output
firecrawl agent "extract products" --schema '{"type":"object","properties":{"name":{"type":"string"},"price":{"type":"number"}}}' --wait -o .firecrawl/products.json
# Focus on specific pages
firecrawl agent "get feature list" --urls "<url>" --wait -o .firecrawl/features.json
Options
| Option | Description |
|---|---|
--urls <urls> | Starting URLs for the agent |
--model <model> | Model to use: spark-1-mini or spark-1-pro |
--schema <json> | JSON schema for structured output |
--schema-file <path> | Path to JSON schema file |
--max-credits <n> | Credit limit for this agent run |
--wait | Wait for agent to complete |
--pretty | Pretty print JSON output |
-o, --output <path> | Output file path |
Tips
- Always use
--waitto get results inline. Without it, returns a job ID. - Use
--schemafor predictable, structured output — otherwise the agent returns freeform data. - Agent runs consume more credits than simple scrapes. Use
--max-creditsto cap spending. - For simple single-page extraction, prefer
scrape— it's faster and cheaper.
See also
- firecrawl-scrape — simpler single-page extraction
- firecrawl-interact — scrape + interact for manual page interaction (more control)
- firecrawl-crawl — bulk extraction without AI
More skills from the firecrawl-codex-plugin repository
View all 8 skillsfirecrawl
search and scrape web content
Jun 30CLIFirecrawlSearchWeb Scrapingfirecrawl-crawl
bulk extract content from websites
Jun 30Data EngineeringFirecrawlWeb Scrapingfirecrawl-interact
interact with scraped web pages
Jun 30AutomationBrowser AutomationFirecrawlWeb Scrapingfirecrawl-map
map website URLs and site structure
Jun 30CLIFirecrawlSearchWeb Scrapingfirecrawl-parse
extract and convert files to markdown
Jun 30Data CleaningDOCXFirecrawlHTML +1firecrawl-scrape
scrape and extract content with Firecrawl
Jun 30AutomationData CleaningFirecrawlWeb Scraping
More from Firecrawl
View publishercompetitor-analysis
analyze competitors across features and pricing
web-agent
Apr 17Competitive IntelligenceFirecrawlResearchdeep-research
conduct multi-source deep research
web-agent
Apr 17FirecrawlKnowledge ManagementResearche-commerce
extract product data from e-commerce sites
web-agent
May 15E-commerceFirecrawlWeb Scrapingfinancial-research
pull financial data for public companies
web-agent
May 15FinanceFirecrawlResearchSEC Filingspricing-tracker
track and compare vendor pricing tiers
web-agent
Apr 17Competitive IntelligenceFirecrawlResearchSaaSstructured-extraction
extract structured data from websites
web-agent
May 15Data EngineeringFirecrawlWeb Scraping