Site Owners Forums - Webmaster Forums - View Single Post

Benjamin M · 01-26-2017, 12:29 AM

A crawler is a program that visits the Web site and reads their pages and other information to create entries in a search engine index.

01-26-2017, 12:29 AM	#9
Benjamin M Registered User Join Date: Jan 2017 Posts: 5	A crawler is a program that visits the Web site and reads their pages and other information to create entries in a search engine index.