Generate sitemap.xml, image-sitemap.xml, llms.txt, and robots.txt for any public website
Submit a domain and get ready-to-upload files plus CSV/TXT reports for 404 links found during the crawl.
Generating your files
Working on your website. Larger websites can take a little while.
- Checking the domain
- Finding public pages
- Reading page titles and descriptions
- Building sitemap.xml
- Building image-sitemap.xml
- Building llms.txt
- Building robots.txt
- Preparing downloads