Thread: What is robots.txt?
View Single Post
Old 03-28-2017, 09:14 PM   #29
justfeelus
Registered User
 
Join Date: Mar 2017
Location: chennai
Posts: 71
an text file that indicates pages not to be crawled
justfeelus is offline   Reply With Quote