Site Owners Forums - Webmaster Forums - View Single Post

josefaryan · 03-06-2012, 03:46 AM

Robots.txt file can be used to tell search engines that which of your website pages/directories should not be crawled.

03-06-2012, 03:46 AM	#2
josefaryan Registered User Join Date: Mar 2012 Posts: 259	Robots.txt file can be used to tell search engines that which of your website pages/directories should not be crawled.