what is spiders,crawlers,bots? - Site Owners Forums

AshokDixit89 · 11-26-2016, 12:36 AM

Crawling- Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages.

Bots or robots - Crawler bots and robots are same. This is an application written in a programming language. This application is used to fetch new and existing websites, a web page from a net. All search engines have their own crawlers.

Spider- A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each web page.

11-26-2016, 12:36 AM	#1
AshokDixit89 Registered User Join Date: Jan 2016 Location: Mumbai, India Posts: 1,064	Crawling- Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages. Bots or robots - Crawler bots and robots are same. This is an application written in a programming language. This application is used to fetch new and existing websites, a web page from a net. All search engines have their own crawlers. Spider- A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each web page. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)