What is Crawler? - Site Owners Forums

sonvi.belani · 01-26-2017, 03:45 AM

Hi,
Crawler (Spider) is a bot which repeatedly browses websites. They are used by search engines in order to grow and refresh their indexes.

and it is:

-->A software program hosted online or locally that manages the capture of web content. Learn more in: Web Archiving
--> 2. Also known as robot or spider, it is a module of a search engine that is responsible for visiting Web sites and extracting their content to be further indexed by the search engine. Learn more in: Spatial Search Engines
-->3. An essential part of a search engine which “crawls” the Web, using its linked structure to find webpages which can be analyzed and stored in a search engine’s index. Learn more in: Search Engines: Past, Present, and Future
--> 4. Program or script which methodically browses databases collecting data about its elements Learn more in: Seek and Ye Shall Find

01-26-2017, 03:45 AM	#1
sonvi.belani Registered User Join Date: Jan 2017 Location: Ahmedabad Posts: 95	Hi, Crawler (Spider) is a bot which repeatedly browses websites. They are used by search engines in order to grow and refresh their indexes. and it is: -->A software program hosted online or locally that manages the capture of web content. Learn more in: Web Archiving --> 2. Also known as robot or spider, it is a module of a search engine that is responsible for visiting Web sites and extracting their content to be further indexed by the search engine. Learn more in: Spatial Search Engines -->3. An essential part of a search engine which “crawls” the Web, using its linked structure to find webpages which can be analyzed and stored in a search engine’s index. Learn more in: Search Engines: Past, Present, and Future --> 4. Program or script which methodically browses databases collecting data about its elements Learn more in: Seek and Ye Shall Find __________________ Sonvi Belani Ecommerce Website Developer To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Crawler working	SAP Online	Search Engine Optimization	11	02-07-2017 11:46 PM
What is the crawler ?	sonamsharma	Search Engine Optimization	16	07-29-2015 05:58 AM
What is Crawler?	eyebridge	Search Engine Optimization	23	07-20-2014 06:01 AM
Crawler a role in SEO	nachiketa	Search Engine Optimization	11	12-30-2013 11:38 PM
Web Crawler	rajivwebads	Search Engine Optimization	12	02-23-2013 11:59 AM

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)