![]() |
#8 |
Registered User
Join Date: Jun 2013
Posts: 10
|
A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot."
|
![]() |
![]() |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Thread Tools | |
Display Modes | Rate This Thread |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
How to Optimize Dynamic Website or Pages? | kajal.pillai22 | Search Engine Optimization | 11 | 04-20-2013 03:33 AM |
Web Crawler | rajivwebads | Search Engine Optimization | 12 | 02-23-2013 11:59 AM |
Google web crawlers | jamesranatte | 3 | 02-20-2012 03:22 PM |