Site Owners Forums - Webmaster Forums - View Single Post

emilyoliver · 01-22-2018, 02:13 AM

No limitations are there in robot.txt file.Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.

01-22-2018, 02:13 AM	#5
emilyoliver Registered User Join Date: Sep 2016 Posts: 248	No limitations are there in robot.txt file.Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.