|
Robots.txt is a text (not HTML) file you put on your site to tell search robots which pages you would like them not to visit. The robots.txt is a very simple text file that is placed in your root directory. It creates to instruct the robots (typically search engine robots) how to crawl and index pages on their website.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|