![]() |
robot
what is a robot txt can anyone tell me ?
|
The robots exclusion standard, also known as the robots exclusion protocol or robots.txt protocol, is a standard used by websites to communicate with web crawlers and other web robots.
|
robots.txt file once implemented.Doesnt allow google to crawl your website.
|
robots.txt file once implemented.Doesnt allow google to crawl your website.
|
All times are GMT -7. The time now is 09:24 AM. |
Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.