View Single Post
Old 11-24-2016, 04:03 AM   #5
Ajaysharma
Registered User
 
Join Date: Nov 2016
Posts: 372
"robots.txt" file is a very Useful file for webmasters and website owners who wish to have a Good control of their website control over Internet and to search engines.

Search Engines go through all the directories and Links of your website and they, sometimes, also go to the folders which you do not wish to let them go to, say website.com/administration/
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Ajaysharma is offline   Reply With Quote