Thread: What is robots.txt used for?
View Single Post
Old 07-20-2016, 01:49 AM   #10
Danielhendry
Registered User
 
Join Date: Jul 2016
Posts: 34
Website communication with web crawler and other web robots. this is basic information for Robot.txt
__________________
Tel Aviv Apartments | Tel Aviv Apartment Rentals | Holiday Rentals Tel Aviv
Danielhendry is offline   Reply With Quote