What are Spiders, Robots and Crawlers and what are their functions? - Site Owners Forums

smmexpertss · 03-05-2018, 12:35 AM

Spiders, Robots and Crawlers all are same these are automated software programme search engine use to stay up to date with web activities and finding new links and information to index in their database. Search engines need to keep their database updated so they created some automated programmes which goes from site to site and find the new data for search engine also collects the information about the web page what is the page all about.

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:

03-05-2018, 12:35 AM	#1
smmexpertss Registered User Join Date: Sep 2015 Location: UK Posts: 447	Spiders, Robots and Crawlers all are same these are automated software programme search engine use to stay up to date with web activities and finding new links and information to index in their database. Search engines need to keep their database updated so they created some automated programmes which goes from site to site and find the new data for search engine also collects the information about the web page what is the page all about.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)