What are Spiders, Robots and Crawlers and what are their functions? - Site Owners Forums

cybexindia15 · 07-27-2016, 03:25 AM

Spiders, robot and crawler, they are all same and referred by different names. It is a software program that follows, or “Crawls” different links throughout the internet, and then grabs the content from the sites and adds to the search engine indexes.

RH-Calvin · 07-29-2016, 01:52 AM

They are all the same and are automated search engine programs that are responsible to read through webpage source to provide information to search engines.

buy pin likes · 07-29-2016, 02:15 AM

Spiders (or crawlers, or bots) are the means through which search engines download the content that is on your website's pages.

Ben Hartz · 07-29-2016, 11:11 AM

its a set of computer programs that browses the www in orderly fashion as well as automatically scans the webpage or website and download a copy to its data to index.

deepakrajput · 07-29-2016, 12:16 PM

Search engines uses these activity during read the site.

07-27-2016, 03:25 AM	#1
cybexindia15 Registered User Join Date: Sep 2013 Posts: 411	What are Spiders, Robots and Crawlers and what are their functions? Spiders, robot and crawler, they are all same and referred by different names. It is a software program that follows, or “Crawls” different links throughout the internet, and then grabs the content from the sites and adds to the search engine indexes. __________________ *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.*

07-29-2016, 01:52 AM	#2
RH-Calvin Registered User Join Date: May 2015 Location: Forum Posts: 2,517	They are all the same and are automated search engine programs that are responsible to read through webpage source to provide information to search engines. __________________ █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| $1 VPS Hosting █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| Windows Server with Remote Desktop Access █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| Servers with Free IPMI Setup

07-29-2016, 02:15 AM	#3
buy pin likes Registered User Join Date: Jul 2016 Posts: 80	Spiders (or crawlers, or bots) are the means through which search engines download the content that is on your website's pages. __________________ *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \|\| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \|\| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \|\| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.*

07-29-2016, 12:16 PM	#5
deepakrajput Registered User Join Date: Feb 2015 Location: CA Posts: 733	Search engines uses these activity during read the site. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-29-2016, 11:11 AM	#4
Ben Hartz Registered User Join Date: Jul 2016 Location: USA Posts: 67	its a set of computer programs that browses the www in orderly fashion as well as automatically scans the webpage or website and download a copy to its data to index.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)