View Single Post
Old 05-23-2014, 03:39 AM   #8
HarveyParker
Registered User
 
Join Date: May 2014
Location: Mumbai
Posts: 6
Robot.txt is a text file which you put in your website to tell search engine which pages you would like not to crawl.
For an Example:

User Agest: *

Disallow:/admin/
Disallow:/epe/de
Disallow:/dwsdf/fdedx/
__________________
Party Planet is one of India’s best Party Planner like
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
&
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Location.
HarveyParker is offline   Reply With Quote