|
Crawler – a program that automatically follows all of the links on each web page.
Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task.
|