What is Crawler?
 

What is Crawler?

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot."

Web crawlers can copy all the pages they visit for later processing by a search engine that indexes the downloaded pages so that users can search them much more quickly.

A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing.

A Web crawler may also be called a Web spider, an ant, an automatic indexer, or (in the FOAF software context) a Web scutter.

Crawler is a spider (robots) which crawl your site and do indexing and other things for what that comes Different types of crawlers are there

A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing.

ya it is true and thanks for your help to remember me those info

A web crawler is a relatively simple automated program, or script, that methodically scans or "crawls" through Internet pages to create an index of the data it's looking for; these programs are usually made to be used only once, but they can be programmed for long-term usage as well.

A crawler is almost like a robot that verify your sites for spamming etc.

A crawling is process of google, in this process crawler read the code of webpage.

thanks for sharing

A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing.

A Web crawler may also be called a Web spider, an ant, an automatic indexer.

Crawler is a bot which is used to crawl the pages and gets indexed.

Crawler is simply a bot or spider of search engine which are used for filtering the contents or website on the bases of quallity and requirments. Crawler systematically browses all the websites of the internet to create a usable index for search engine.

A crawler is a spider (robots) that visit Web sites and reads their pages and other information in order to create entries for a search engine index.

thank you so much for sharing about crawler.