|
Robot.txt is a file that instructs crawlers and bots whether to crawl a page or not. If yes then which page, etc.
You can allow or disallow bots from crawling your pages.
__________________
If you are not receiving enough comments on your blog, then read how I
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
..
For blogging tips, visit SayBlogger | A
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|