Robots.txt Generator

Robot file generator

Leave blank if you don't have.
Google
Google Image
Google Mobile
MSN Search
Yahoo
Yahoo MM
Yahoo Blogs
Ask/Teoma
GigaBlast
DMOZ Checker
Nutch
Alexa/Wayback
Baidu
Naver
MSN PicSearch
The path is relative to the root and must contain a trailing slash "/".
Related Tools
Twitter Card Generator
Get HTTP Headers
Server Status Checker
WordPress Theme Detector
Hosting Checker
Open Graph Generator

This handy Robots.txt generator will generate a working Robots.txt file for any given website so that you can be sure that the different Robots can all find the pages of your website and index them properly.

Popular Tools
Download YouTube Channel Banner
Adsense Calculator
WordPress Theme Detector
Whois Domain Lookup
Domain Age Checker
Robots.txt Generator
Google Index Checker
Alexa Rank Checker
Keyword Density Checker
Recent Posts
Avatar
How to Check YouTube Trends and Grow Your Audience with the Best Strategies January 28, 2023