View Single Post
Old 01-24-2019, 12:14 AM   #2
mausin12991
Registered User
 
Join Date: May 2013
Posts: 109
The robots.txt file is a text file that tells web robots (most often search engines) which pages on your site to crawl. It also tells web robots which pages not to crawl.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
mausin12991 is offline   Reply With Quote