11-21-2014, 12:03 AM
|
#1 |
|
Registered User
Join Date: Sep 2014
Location: Bangalore,Karnataka
Posts: 133
|
Importance of Robots.txt File
When a search engine crawler involves your web site, it'll look for a special file on your site named robots.txt and it tells the search engine spider, that web pages of your website should be indexed.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is the purpose of robots.txt file? | sahithya | Search Engine Optimization | 23 | 12-28-2021 03:48 AM |
| What Is A Robots.txt File? | ThedorisJackson | General Discussion | 5 | 07-22-2014 04:28 AM |
| How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
| The robots.txt file | rubberfender | Yahoo | 0 | 12-02-2012 07:32 PM |
| Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |
All times are GMT -7. The time now is 02:43 AM.