Free tool · AI & GEO
llms.txt inspector and generator
Check whether a website publishes an llms.txt file and whether it follows the proposed format, or generate one from the site’s pages and sitemap. An experimental format: useful to try, with no guaranteed effect.
llms.txt Generator & Inspector
Experimental format. llms.txt is a community proposal (llmstxt.org), not a web standard. Google has said it does not use it for Search, and no AI provider guarantees that it reads the file. Publishing one does not improve rankings or guarantee AI citations.
Build an llms.txt or agents.md file by hand
Generated file
Your file
What llms.txt is
A proposal, not a standard
llms.txt was proposed in September 2024 at llmstxt.org as a Markdown file at the root of a website that gives language models a short summary of the site and links to its most useful pages, ideally in clean Markdown. The format is simple: an H1 with the site name, a blockquote summary, optional details, and H2 sections with lists of links, including an “Optional” section for secondary material. Some sites also publish llms-full.txt with the full content.
Adoption is mixed. Documentation sites and developer tools publish it most often, and some AI coding tools read it when you point them at a site. Google has said it does not use llms.txt for Search, and the major AI providers have not committed to reading it for their search or answer products.
What it will and will not do
An llms.txt file does not improve Google rankings, and it does not guarantee that ChatGPT, Gemini, Claude, Perplexity or any other system reads, uses or cites your content. It can help tools and agents that look for it find your key pages quickly. Treat it as a low-cost experiment alongside the things that demonstrably matter: crawler access, server-rendered content, clear structure and accurate structured data.
What the tool checks
Inspect, propose or build by hand
Inspection
Whether /llms.txt and /llms-full.txt exist, the status code and content type, and whether the address returns an HTML page instead of a text file (a common soft 404).
Format check
A single H1 title first, a blockquote summary, H2 sections, links in the “- [Title](URL): notes” form, absolute URLs, no HTML, a reasonable size, and a status check of up to 12 linked pages.
Generated proposal
A draft built from the homepage’s internal links and the XML sitemap, grouped by site section, with legal pages and the sitemap under Optional. Titles for sitemap URLs are derived from their addresses, so the draft needs editing.
Manual builder
A form for name, summary, key pages, policies, sitemap and product feed that builds llms.txt or agents.md as you type, entirely in your browser.
How to publish one
Keep it short and current
- 01Start from the proposal
Remove pages that do not help someone understand what you offer, such as tag archives, thin pages and duplicates.
- 02Add notes to important links
A few words after each link (“- [Pricing](https://…): plans, limits and billing FAQ”) help a reader choose the right page.
- 03Publish it at the root
Upload it as /llms.txt, served as text/plain or text/markdown in UTF-8. Keep robots.txt consistent: listing pages you block from crawlers sends a mixed message.
- 04Maintain it
Update it when key pages move. A stale file with broken links is worse than none.
Questions
About llms.txt
Which AI crawlers can actually reach your pages matters more than llms.txt. Check your robots.txt rules first.
Is llms.txt like robots.txt?
No. robots.txt is an established standard (RFC 9309) that tells crawlers what they may fetch. llms.txt does not grant or deny access; it is a reading guide, and nothing is obliged to read it.
Should an online store publish one?
It does little harm and takes an hour. Point to categories, delivery, returns, warranty and contact pages, and to your product feed if it is public. Product structured data and accurate feeds remain far more important for shopping features.
What is agents.md?
AGENTS.md is a separate convention for instructions to AI coding agents working in a code repository. The manual builder can produce either file; for websites, llms.txt is the relevant one.
Is anything stored?
Inspection results are cached for 20 minutes, then deleted. The manual builder runs entirely in your browser.
Need help with what
the tools found?
HUB engineers implement technical SEO, performance, security and AI-readiness fixes on WordPress, Magento, custom PHP and modern JavaScript stacks.