Site Owners Forums - Webmaster Forums - View Single Post

alivetechies · 07-21-2015, 10:34 AM

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.

07-21-2015, 10:34 AM	#2
alivetechies Registered User Join Date: Jul 2015 Location: USA Posts: 1	A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.