What are Spiders, Robots and Crawlers and what are their functions? - Site Owners Forums

		Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization
What are Spiders, Robots and Crawlers and what are their functions?

FAQ

Calendar

Today's Posts

Notices

Welcome to SiteOwnersForums.com #1 Webmasters Community Online

You are currently viewing our forum as a guest which gives you limited access.
Membership is absolutely FREE and registration is FAST & SIMPLE so please, Register Today and join one of the friendliest communities on the net!
If you have any problems with the registration process or your account login, please contact us.

Thread Tools

Rate Thread

Display Modes

04-02-2019, 02:41 AM	#1
rajkiran Registered User Join Date: Aug 2016 Posts: 961	Crawler: Also known as Robot, Bot or Spider. These are programs used by search engines to explore the Internet and automatically download web content available on web sites. They capture the text of the pages and the links found and thus enable search engine users to find new pages.

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is Off HTML code is Off Forum Rules

Forum Jump

All times are GMT -7. The time now is 05:05 PM.