What is a web crawler?
A web crawler is an automated program used by search engines to browse the web, index content, and update search engine databases with relevant information.