View Single Post
Old 01-28-2016, 10:42 PM   #5
austin11
Registered User
 
Join Date: Oct 2013
Posts: 77
Robots.txt file is used to tell search robots which pages you would like them not to visit. By defining a few rules in this text file, you can instruct robots to not crawl certain files, directories within your site, or at all.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
austin11 is offline   Reply With Quote