Thread: what is robots.txt?
View Single Post
Old 05-28-2017, 09:37 PM   #5
Mouni
Registered User
 
Join Date: May 2017
Posts: 66
Robots.txt file instructs the search engine crawlers about pages of the sites it has to index.
Mouni is offline   Reply With Quote