robot.txt is the text file its help to stop the crawler to index the page which is not allow in the robot.txt and its upload with help of the google webmaster tools and code of robot.txt look like such as the
user agent: *
Disallow /abc/
disallow /xyz/
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|