Firecrawl logo

Skill

firecrawl-map

map website URLs and site structure

Covers Web Scraping CLI Firecrawl Search

Description

Discover and list all URLs on a website, with optional search filtering. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", or "list all pages". Essential when the user knows which site but not which exact page.

SKILL.md

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

When to use

  • You need to find a specific subpage on a large site
  • You want a list of all URLs on a site before scraping or crawling
  • Step 3 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Options

OptionDescription
--limit <n>Max number of URLs to return
--search <query>Filter URLs by search query
--sitemap <include|skip|only>Sitemap handling strategy
--include-subdomainsInclude subdomain URLs
--jsonOutput as JSON
-o, --output <path>Output file path

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authenticationscrape that URL.

See also

© 2026 YourAI.tools. Every skill from an identity-verified publisher.

Independent catalog. Not affiliated with, endorsed by, or sponsored by Anthropic or any listed publisher. All trademarks belong to their respective owners.