Thread: robots.txt
View Single Post
Old 07-26-2012, 11:40 PM   #1
wheelbarrow001
Registered User
 
Join Date: Nov 2011
Posts: 35
robots.txt

The robots.txt is a stored in the root directory of the web site under ASCII coding text files, it usually against Internet search led also called web spiders, which of the site should not be content is search engine for the rovers, which can be obtained
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
wheelbarrow001 is offline   Reply With Quote