Thread: Robot.txt?
View Single Post
Old 01-08-2015, 11:36 PM   #12
Cleantekmarket
Registered User
 
Join Date: Jan 2015
Posts: 6
Robots.txt is a text file, It is used to allow or disallow search engines to crawl your website or webpage
Cleantekmarket is offline   Reply With Quote