Thread: what is robots.txt?
View Single Post
Old 12-06-2017, 11:14 PM   #4
oyecaptain
Registered User
 
Join Date: Nov 2016
Location: India
Posts: 81
Robots txt in generally for use information our crawlers website.
oyecaptain is offline   Reply With Quote