what is spiders,crawlers,bots? - Site Owners Forums

AshokDixit89 · 11-14-2016, 01:06 AM

Crawler - Crawler or Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages.

Spider- A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each web page.

Robots - Crawler bots and robots are same. This is an application written in a programming language. This application is used to fetch new and existing websites, a web page from the net. All search engines have their own crawlers.

11-14-2016, 01:06 AM	#4
AshokDixit89 Registered User Join Date: Jan 2016 Location: Mumbai, India Posts: 1,064	Crawler - Crawler or Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages. Spider- A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each web page. Robots - Crawler bots and robots are same. This is an application written in a programming language. This application is used to fetch new and existing websites, a web page from the net. All search engines have their own crawlers. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)