Site Owners Forums - Webmaster Forums - View Single Post

AnnMag · 09-02-2016, 04:38 AM

A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler.

09-02-2016, 04:38 AM	#1
AnnMag Registered User Join Date: Aug 2016 Posts: 54	A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler.