SEOTrack

Robots.txt exists

A text file named "robots.txt" will be read by search engine crawlers and used to determine which sections of your site should be indexed and which should not.

Related links:

http://www.robotstxt.org/