Site Owners Forums - Webmaster Forums - View Single Post

laceywilliams12 · 12-04-2012, 11:07 PM

Robots.txt is a text file and having the information for dofollow or no-follow for the crawlers to crawl a website web pages, and providing them indexing.

12-04-2012, 11:07 PM	#11
laceywilliams12 Registered User Join Date: Nov 2012 Posts: 71	Robots.txt is a text file and having the information for dofollow or no-follow for the crawlers to crawl a website web pages, and providing them indexing.