Site Owners Forums - Webmaster Forums - View Single Post

ubitestechnolog · 09-11-2014, 11:43 PM

Robots.txt is a file in the root directory of your web site that instructs web crawlers what parts, or all, or none of your site they are allowed examine.

09-11-2014, 11:43 PM	#8
ubitestechnolog Registered User Join Date: Sep 2014 Posts: 14	Robots.txt is a file in the root directory of your web site that instructs web crawlers what parts, or all, or none of your site they are allowed examine.