Site Owners Forums - Webmaster Forums - View Single Post

mytimeandmoneys · 11-26-2012, 07:42 AM

Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do.

11-26-2012, 07:42 AM	#3
mytimeandmoneys Registered User Join Date: Nov 2012 Posts: 5	Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do.