12-18-2017, 12:24 AM
|
#3 |
|
Registered User
Join Date: Mar 2016
Posts: 214
|
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| How to put Robot.txt in website? | authenticdecora | Search Engine Optimization | 1 | 10-12-2017 12:27 AM |
| What is robot.txt file and what are the benefits of using it? | Martinricky | Social Networks | 31 | 12-21-2016 02:46 AM |
| Robot.txt? | siva SEO | Search Engine Optimization | 17 | 01-09-2015 07:02 PM |
| How to know about robot.txt ? | vanaja | Search Engine Optimization | 10 | 10-08-2014 04:39 AM |
All times are GMT -7. The time now is 08:20 PM.