
Description
Discover and list all URLs on a website, with optional search filtering. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", or "list all pages". Essential when the user knows which site but not which exact page.
SKILL.md
firecrawl map
Discover URLs on a site. Use --search to find a specific page within a large site.
When to use
- You need to find a specific subpage on a large site
- You want a list of all URLs on a site before scraping or crawling
- Step 3 in the workflow escalation pattern: search → scrape → map → crawl → interact
Quick start
# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt
# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json
Options
| Option | Description |
|---|---|
--limit <n> | Max number of URLs to return |
--search <query> | Filter URLs by search query |
--sitemap <include|skip|only> | Sitemap handling strategy |
--include-subdomains | Include subdomain URLs |
--json | Output as JSON |
-o, --output <path> | Output file path |
Tips
- Map + scrape is a common pattern: use
map --searchto find the right URL, thenscrapeit. - Example:
map https://docs.example.com --search "auth"→ found/docs/api/authentication→scrapethat URL.
See also
- firecrawl-scrape — scrape the URLs you discover
- firecrawl-crawl — bulk extract instead of map + scrape
More skills from the firecrawl-codex-plugin repository
View all 8 skillsfirecrawl
search and scrape web content
Jun 30CLIFirecrawlSearchWeb Scrapingfirecrawl-agent
extract structured data from websites
Jun 30AutomationData AnalysisFirecrawlWeb Scrapingfirecrawl-crawl
bulk extract content from websites
Jun 30Data EngineeringFirecrawlWeb Scrapingfirecrawl-interact
interact with scraped web pages
Jun 30AutomationBrowser AutomationFirecrawlWeb Scrapingfirecrawl-parse
extract and convert files to markdown
Jun 30Data CleaningDOCXFirecrawlHTML +1firecrawl-scrape
scrape and extract content with Firecrawl
Jun 30AutomationData CleaningFirecrawlWeb Scraping
More from Firecrawl
View publishercompetitor-analysis
analyze competitors across features and pricing
web-agent
Apr 17Competitive IntelligenceFirecrawlResearchdeep-research
conduct multi-source deep research
web-agent
Apr 17FirecrawlKnowledge ManagementResearche-commerce
extract product data from e-commerce sites
web-agent
May 15E-commerceFirecrawlWeb Scrapingfinancial-research
pull financial data for public companies
web-agent
May 15FinanceFirecrawlResearchSEC Filingspricing-tracker
track and compare vendor pricing tiers
web-agent
Apr 17Competitive IntelligenceFirecrawlResearchSaaSstructured-extraction
extract structured data from websites
web-agent
May 15Data EngineeringFirecrawlWeb Scraping