|
The basic format to write a robots.txt file is
User-agent: *
Disallow: /url1/
Disallow: /url2/
Disallow: /url.html
If you want to disallow few webpages crawling from search engines then you can add in this robots.txt file
__________________
Live TV Services -
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|