Site Owners Forums - Webmaster Forums - View Single Post

stuartspindlow9 · 03-14-2016, 05:13 AM

Robots.txt is common name of a text file that is uploaded to a Web site's root directory and linked in the html code of the Web site. The robots.txt file is used to provide instructions about the Web site to Web robots and spiders.

03-14-2016, 05:13 AM	#5
stuartspindlow9 Registered User Join Date: Jan 2016 Location: Thailand Posts: 32	Robots.txt is common name of a text file that is uploaded to a Web site's root directory and linked in the html code of the Web site. The robots.txt file is used to provide instructions about the Web site to Web robots and spiders.