Site Owners Forums - Webmaster Forums - View Single Post

rolinsebra · 10-04-2016, 04:29 AM

Web site owners use the robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.

10-04-2016, 04:29 AM	#16
rolinsebra Registered User Join Date: Oct 2016 Posts: 2	Web site owners use the robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. Last edited by rolinsebra; 11-12-2016 at 07:58 AM..