Robot.txt file is a file which contains the webpages which one don't want to be crawled by the crawler.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|