|
|
03-02-2017, 11:57 PM
|
#1 |
|
Registered User
Join Date: Jan 2017
Location: hyderabad
Posts: 78
|
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
 |
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Hybrid Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Check the website robots file | china-jewels | Bing | 4 | 10-11-2015 08:14 AM |
| Uses of robots? | jamesranatte | General Discussion | 2 | 12-11-2014 08:32 AM |
| Robots exclusion protocols? | jamesranatte | General Discussion | 7 | 12-26-2013 12:01 AM |
| what is difference between spider, crawler and robots? | noahwilson | Search Engine Optimization | 0 | 05-30-2013 03:04 AM |
| What is Robots meta tag? | samlko | Search Engine Optimization | 2 | 04-06-2012 12:10 AM |
All times are GMT -7. The time now is 10:32 AM.