Sitemap Generator

    Sitemap Generator

    Generate XML sitemaps for search engines

    Enter any website URL to automatically crawl and discover all pages. Our advanced crawler is more powerful than search engines and can discover deep pages, dynamic routes, and hidden content.

    About the Sitemap Generator

    An XML sitemap is the file search engines read to discover every important URL on your site. For small sites Google can find pages by crawling internal links; for large sites, SPAs, or content behind deep navigation, a sitemap dramatically accelerates indexing and tells crawlers which pages matter most (via priority) and how often they change (via changefreq). This tool crawls your site server-side — no CORS limits, no browser proxy — and emits a standards-compliant sitemap.

    Features

    How it works

    1. Enter the root URL of your site.
    2. Our server fetches robots.txt, probes /sitemap.xml, then BFS-crawls internal links.
    3. URLs stream in live as they're discovered.
    4. Copy the XML or download sitemap.xml and submit it to Google Search Console.

    Use cases

    Frequently asked questions

    Why did I only get the homepage back?

    +

    Either the site is a single-page app (routes rendered by JS — our server crawler only sees static HTML), or the site blocks bot user-agents. For JS-heavy sites, include a public sitemap.xml on your server.

    Do I need to submit this to Google?

    +

    Yes — upload the XML to your server, then add the URL under Search Console → Sitemaps. Without submission, Google discovers it only when referenced in robots.txt.

    How deep does the crawl go?

    +

    Up to depth 6, with caps of 500 URLs and 120 pages and a 90-second overall deadline, to stay polite and avoid timing out.

    Is the output Google-compliant?

    +

    Yes — it conforms to the sitemaps.org 0.9 schema, which Google, Bing, and DuckDuckGo all accept.

    Can I crawl login-protected pages?

    +

    No. The crawler runs unauthenticated, so any page behind a login is invisible to it (and to search engines).