Site Owners Forums - Webmaster Forums - View Single Post

riwseo · 07-22-2014, 04:28 AM

Its Txt file by which you can tell search engine that what area of your site is allowed to crawl or store in a database or index.

07-22-2014, 04:28 AM	#6
riwseo Registered User Join Date: Jul 2014 Posts: 648	Its Txt file by which you can tell search engine that what area of your site is allowed to crawl or store in a database or index.