Site Owners Forums - Webmaster Forums - View Single Post

Paul Jameson · 08-16-2012, 06:05 AM

Robot.txt is main function which guides search engine to find pages on your website to crawl. It is text file which you place on your root directory.

08-16-2012, 06:05 AM	#7
Paul Jameson Registered User Join Date: Aug 2012 Posts: 22	Robot.txt is main function which guides search engine to find pages on your website to crawl. It is text file which you place on your root directory.