Robot.txt is a text file which you put in your website to tell search engine which pages you would like not to crawl.
For an Example:
User Agest: *
Disallow:/admin/
Disallow:/epe/de
Disallow:/dwsdf/fdedx/
__________________
Party Planet is one of India’s best Party Planner like To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. , To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. & To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. Location.
|