This is the software created by search engines and could be referred to as bots, robots or crawlers as well. They automatically roam the Internet, reporting all the web page contents back to search engine databases and indexes. They are constructed and deployed by search engines to build and add to their index.