03-20-2013, 11:50 PM
|
#13 |
|
Registered User
Join Date: Feb 2013
Location: delhi
Posts: 103
|
robots.txt file is very important to crawl or not crawls the pages. as we give coding
User-Agent: * Disallow: if you want to disallow the page disallow:/ event management companies in kolkata
__________________
camp in kanatal |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| Display Modes | Rate This Thread |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
| How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
| The robots.txt file | rubberfender | Yahoo | 0 | 12-02-2012 07:32 PM |
| Does Anyone Know About The Importance Of SEO? | brettlee585 | Search Engine Optimization | 5 | 11-26-2012 05:15 AM |
| Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |
All times are GMT -7. The time now is 12:54 AM.