How can we help?

Creating a sitemap with Sitemap.ai is simple:

1. Enter your website URL in the input field on the homepage
2. Click "Generate" to begin the automatic crawl process
3. Wait for the crawler to discover up to 500 URLs (5,000 with free account)
4. Download the XML sitemap, llms.txt, HTML sitemap, CSV, or per-page markdown bundle

Logged-in crawls are saved under a project (one per domain) so you can re-run them anytime. No signup required for basic usage (up to 500 URLs per crawl).

No account is required for basic sitemap generation! You can crawl any website and download up to 500 URLs without signing up.

However, creating a free account gives you:

• Higher limits: 5,000 URLs per crawl (vs 500 without account — 10X more!)
• Monthly allowance: 50,000 URLs per month
• JavaScript rendering for React, Next.js, Vue, and other client-rendered sites
• Up to 5 projects (one per domain) with unlimited saved crawls per project
• One-click re-crawling of any project
• Scheduled automatic re-crawls — daily, weekly, every 2 weeks, or monthly, with email alerts
• Faster crawling rates
• Access to crawl history per project

Without an account:

You can crawl any website and download up to 500 URLs per crawl. You won't be able to save crawls to your account, but you can download the results immediately. This is perfect for smaller websites and trying out the service.

With a free account:

Creating a free account unlocks higher limits:

• Up to 5,000 URLs per crawl (10X more than without account)
• Up to 50,000 URLs per month total
• Up to 5 projects (one per domain) with unlimited saved crawls per project
• One-click re-crawls of any project
• Scheduled automatic re-crawls (daily, weekly, every 2 weeks, or monthly)
• JavaScript rendering for SPAs (React, Next.js, Vue, etc.)
• Faster crawling rates

Need higher limits or enterprise features? Please use the contact form above to get in touch.

Every crawl produces multiple file outputs from a single run:

• XML sitemap — standard format for search engines (Google, Bing, etc.)
• llms.txt — structured index for AI crawlers (ChatGPT, Claude, Perplexity, Gemini)
• HTML sitemap — human-readable format for visitors
• CSV — spreadsheet format for analysis
• Per-page markdown bundle — one clean .md file per page in a zip, nav and chrome stripped, built for feeding LLMs and RAG pipelines (export requires a free account)

After generating your XML sitemap:

1. Upload the sitemap.xml file to your website's root directory (e.g., https://example.com/sitemap.xml)
2. Go to Google Search Console
3. Select your property (website)
4. Navigate to "Sitemaps" in the left sidebar
5. Enter your sitemap URL and click "Submit"

You should also submit to Bing Webmaster Tools for better coverage.

Yes, we take your privacy seriously:

• We only extract URL links from pages you crawl
• We do NOT store full page content or personal data from crawled sites — the per-page markdown bundle is extracted in your browser at download time
• For guests, results are temporarily stored in your browser for your session only
• For logged-in users, saved crawls are stored securely and only accessible to you
• We use encryption for all data transmission

See our Privacy Policy for full details.

Sitemap.ai has one main generator and four free tools, each with a distinct purpose:

• XML Sitemap Generator — crawls your website and produces an XML sitemap, llms.txt, HTML sitemap, CSV, and per-page markdown bundle from a single run
• Sitemap Finder — discovers existing sitemaps on any website by checking common locations, robots.txt, and sitemap-index files
• Sitemap Validator — validates XML sitemaps against the sitemaps.org spec and surfaces schema, URL, and protocol issues
• Markdown Validator — validates any markdown document for broken links and images, malformed front-matter, heading hierarchy, unclosed code fences, and table column mismatches
• llms.txt Finder — checks whether any website publishes an llms.txt file and parses the contents (site name, sections, link count)

A project is one website (domain) tracked under your account. Logged-in crawls automatically attach to the project for that domain, so all your saved crawls, generated files, and crawl history for a given site live in one place. Re-crawling is one click from the project view.

Free accounts get up to 5 projects (one per domain) with unlimited saved crawls per project. You can create projects for the domains you care about most and re-run them whenever you publish — or put them on a schedule to re-crawl automatically.

When you create a project — or anytime afterward in its settings — pick a crawl frequency: daily, weekly, every 2 weeks, or monthly. We'll re-crawl the site on that cadence on our servers and email you (and post to Slack, if you've connected a webhook) when each run finishes.

Scheduled crawls run in the background — you don't need to keep a tab open — and regenerate your sitemap, llms.txt, and markdown each time, so everything stays current between publishes. It's free with an account, within your monthly URL allowance.

llms.txt is an emerging standard for telling AI crawlers (ChatGPT, Claude, Perplexity, Gemini) which content on your site is worth reading and citing. Think of it as robots.txt + sitemap.xml combined, in a format optimized for LLMs — titles and short descriptions in a clean, structured markdown index.

Every crawl produces one automatically from the discovered URLs, alongside the standard XML sitemap. You can also use the llms.txt Finder to check whether any third-party site publishes one.

The markdown bundle is a zip of one .md file per crawled page, with navigation, footer, ads, and other chrome stripped out. It's designed for feeding LLMs, RAG pipelines, and embedding workflows — you get clean, readable text in a developer-friendly format without having to write your own scraper or HTML-to-markdown converter.

It's produced from the same crawl as your XML sitemap and llms.txt — one crawl, every file.

Yes. Sitemap.ai can be used for both personal and commercial websites.

Free tier includes:

• Without account: Up to 500 URLs per crawl (download only, cannot save)
• With free account: Up to 5,000 URLs per crawl, 50,000 URLs per month, up to 5 projects (one per domain) with unlimited saved crawls, and scheduled automatic re-crawls

Need higher limits or enterprise features for a larger commercial project? Please use the contact form above.

Sometimes servers block our crawler from accessing their content. This can happen for several reasons:

• The website has strict bot protection or firewall rules
• The server is configured to block automated crawlers
• The website's robots.txt file disallows crawling
• Temporary server issues or downtime

If you encounter this issue, please use the contact form above to send us the website URL. We'll investigate and see if we can help resolve the crawling issue.

Yes. With a free account, you can enable JavaScript rendering to crawl dynamic websites built with modern frameworks like React, Next.js, Vue, Angular, and others.

How it works:

• Our crawler renders each page in a real Chromium browser (Puppeteer)
• All dynamically-loaded content and client-side links are discovered
• Perfect for Single Page Applications (SPAs) and dynamic sites

Limitations:

• JS rendering is slower than standard crawling (each page takes longer to process)
• Some sites with aggressive bot protection may still block the crawler
• Requires a free account to access this feature