Home » Glossary » Crawler
3 A B C D E F G H I J K L M N O P Q R S T U V W Y


by Tom Bowen
0 comment

Also called a web crawler, spider, it’s a software that has been specifically designed to automatically browse the internet. Google uses a number of crawlers to constantly map all the sites on the internet and use it in its search engine.

0 comment