|
The robots.txt file is a set of instructions for robots visiting that index the content of your web site pages. For those spiders that obey the file, it provides a map for what they can, and cannot index. The file must reside in the root directory of your web.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|