Media Sova
Robots.txt Generator
Create a basic robots.txt file for your website and adapt it to your indexing needs.
Website domain
Domain without http/https, WWW and trailing slash.
User-agent:
Specific search engine directive.
Disallow:
What to index or not to index for search engines.
Host:
Domain name with or without www.
Sitemap:
Specify the location of the sitemap, if available.
Ask a question
Generate a robots.txt file online for your website with user-agent, allow, disallow, sitemap and crawl-delay directives.