A Blank Robots.txt File

Search Engine Optimization forum discussing general tips and tricks to optimize your website for the search engines as a white hat or black hat. Find ideas to fine tune your website for top rankings using keywords, meta tags, SEF, linkbacks, and our

Moderator: derek88

A Blank Robots.txt File

Postby jconnel » Mon Jan 11, 2010 5:46 am

If you want to allow robots/spiders to index all of the content it finds on your webpage then you can use the following in your robots.txt file .

User-agent: *

Disallow:

It is preferred for Google that you have either a blank robots.txt file, or you have the content above. If the request for the robots.txt file on your domain returns an error or a redirect status, your domain is at risk of being removed from the index.
jconnel
EIS JUNIOR
 
Posts: 40
Joined: Sun Jan 10, 2010 4:45 pm

Return to Search Engine Optimization

Who is online

Users browsing this forum: No registered users and 7 guests

cron