"robots.txt" file is a very Useful file for webmasters and website owners who wish to have a Good control of their website control over Internet and to search engines.
Search Engines go through all the directories and Links of your website and they, sometimes, also go to the folders which you do not wish to let them go to, say website.com/administration/
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|