Site Owners Forums - Webmaster Forums - View Single Post

Vishal Arora · 01-26-2017, 03:28 AM

A web crawler is an automated program, or script, that methodically scans or “crawls” through web pages to create an index of the data it is set to look for. This process is called Web crawling or spidering.

01-26-2017, 03:28 AM	#10
Vishal Arora Registered User Join Date: Jan 2017 Location: Jaipur, Rajasthan, India Posts: 78	A web crawler is an automated program, or script, that methodically scans or “crawls” through web pages to create an index of the data it is set to look for. This process is called Web crawling or spidering.