Deference between robots and crawlers - Site Owners Forums

rajjnisspra · 08-12-2013, 11:55 PM

What is deference between robots and crawlers ?
day picnic near delhi | jaipur group tour package

Shane Bentick · 05-10-2017, 11:23 PM

Crawlers are programs used by search engines to explore the Internet and automatically download web content available on web sites. They capture the text of the pages and the links found, and thus enable search engine users to find new pages.

Robots performs three basic actions:
1.First they find the pages of the site and build a list of words and phrases found in every page.
2.With this list they create a database and find the exact pages they should seek by entering the query in search option.
3. After that, the robot is able to find the site when the end user type a word or phrase. This step is called query processor.

tennywilson · 07-07-2017, 04:38 AM

Crawler – a program that automatically follows all of the links on each web page.

Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task.

prometheas · 07-07-2017, 04:58 AM

Crawlers are referring to the programs that search engines use to scan and analyze websites in order to determine their importance, and thus their ranking in the results of internet searches for certain keywords.

Robots is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.

robertson91 · 07-08-2017, 03:19 AM

Crawler – a program that automatically follows all of the links on each web page.

Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task.

08-12-2013, 11:55 PM	#1
rajjnisspra Registered User Join Date: Jul 2013 Location: Delhi Posts: 70	Deference between robots and crawlers What is deference between robots and crawlers ? day picnic near delhi \| jaipur group tour package Last edited by rajjnisspra; 08-12-2013 at 11:58 PM..

05-10-2017, 11:23 PM	#2
Shane Bentick Registered User Join Date: Apr 2017 Posts: 355	Crawlers are programs used by search engines to explore the Internet and automatically download web content available on web sites. They capture the text of the pages and the links found, and thus enable search engine users to find new pages. Robots performs three basic actions: 1.First they find the pages of the site and build a list of words and phrases found in every page. 2.With this list they create a database and find the exact pages they should seek by entering the query in search option. 3. After that, the robot is able to find the site when the end user type a word or phrase. This step is called query processor. __________________ gmc yukon car cover \| yukon xl car covers \| lincoln town car car cover\| jeep grand cherokee car covers

07-07-2017, 04:38 AM	#3
tennywilson Registered User Join Date: Nov 2016 Posts: 356	Crawler – a program that automatically follows all of the links on each web page. Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. __________________ apps developers \| mobile app development services \| android app development services \| iphone application developer

07-07-2017, 04:58 AM	#4
prometheas Registered User Join Date: Feb 2017 Posts: 14	Crawlers are referring to the programs that search engines use to scan and analyze websites in order to determine their importance, and thus their ranking in the results of internet searches for certain keywords. Robots is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website. __________________ Best web design company in india\| Web development company india \| SEO Company in india \| Payroll software free download

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
What is crawlers?	danish00	Search Engine Optimization	12	07-01-2013 01:42 AM

07-08-2017, 03:19 AM	#5
robertson91 Registered User Join Date: Jun 2017 Posts: 173	Crawler – a program that automatically follows all of the links on each web page. Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)