Sitemap Generator
Generate XML sitemaps for search engines
Enter any website URL to automatically crawl and discover all pages. Our advanced crawler is more powerful than search engines and can discover deep pages, dynamic routes, and hidden content.
How to use
- Enter your website URLs
- Set priority and change frequency
- Download the XML sitemap
Use cases
- SEO optimization
- Search engine indexing
- Website structure planning
- Content organization
About the Sitemap Generator
An XML sitemap is the file search engines read to discover every important URL on your site. For small sites Google can find pages by crawling internal links; for large sites, SPAs, or content behind deep navigation, a sitemap dramatically accelerates indexing and tells crawlers which pages matter most (via priority) and how often they change (via changefreq). This tool crawls your site server-side — no CORS limits, no browser proxy — and emits a standards-compliant sitemap.
Features
- Server-side crawl — bypasses CORS, no browser proxy chain
- robots.txt + sitemap.xml auto-discovery
- Recursive sitemap index support
- BFS link following with 500 URL / 120 page caps
- XML-escaped output, download or copy directly
How it works
- Enter the root URL of your site.
- Our server fetches robots.txt, probes /sitemap.xml, then BFS-crawls internal links.
- URLs stream in live as they're discovered.
- Copy the XML or download sitemap.xml and submit it to Google Search Console.
Frequently asked questions
Why did I only get the homepage back?
+
Either the site is a single-page app (routes rendered by JS — our server crawler only sees static HTML), or the site blocks bot user-agents. For JS-heavy sites, include a public sitemap.xml on your server.
Do I need to submit this to Google?
+
Yes — upload the XML to your server, then add the URL under Search Console → Sitemaps. Without submission, Google discovers it only when referenced in robots.txt.
How deep does the crawl go?
+
Up to depth 6, with caps of 500 URLs and 120 pages and a 90-second overall deadline, to stay polite and avoid timing out.
Is the output Google-compliant?
+
Yes — it conforms to the sitemaps.org 0.9 schema, which Google, Bing, and DuckDuckGo all accept.
Can I crawl login-protected pages?
+
No. The crawler runs unauthenticated, so any page behind a login is invisible to it (and to search engines).