Site Owners Forums - Webmaster Forums - View Single Post

rajkiran · 01-04-2017, 02:17 AM

robots.txt is a text file webmasters create to instruct robots, how to crawl and index pages on their website.

01-04-2017, 02:17 AM	#12
rajkiran Registered User Join Date: Aug 2016 Posts: 961	robots.txt is a text file webmasters create to instruct robots, how to crawl and index pages on their website.