|
||||||||
| Notices |
|
|
Thread Tools | Rate Thread | Display Modes |
05-05-2017, 04:18 AM
|
#8 |
|
Registered User
Join Date: Apr 2017
Posts: 355
|
Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do.
The purpose of a robots.txt file is to tell search engines not to crawl the contents of specific directories or even individual pages within a website.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
All times are GMT -7. The time now is 08:49 PM.