Robots.txt generator
Tell crawlers
Tell crawlers
what to read.
Generate a safe robots.txt — control search engines and AI training bots, block private paths, and add your sitemap — plus an llms.txt starter for AI assistants. Copy and save at your site root.
Your site URL for the sitemap line
Search-engine crawlers
Block these paths one per line, optional
AI training crawlers GPTBot, ClaudeBot, Google-Extended…
Business name for the llms.txt starter
One-line description
robots.txtllms.txt starter
Save robots.txt and llms.txt at your site's root. llms.txt is an emerging standard that helps AI assistants understand your site — ours is at stonekept.studio/llms.txt.
robots.txt is a set of instructions that well-behaved crawlers follow; it is not a security control and does not hide pages from people. Save the file at your site's root (yoursite.com/robots.txt).
Let's build something lasting
Let's turn this into
Let's turn this into
a real plan.
Tell us what you're building and we'll send a straight, fixed proposal — no pressure, no sales fog.