What is web crawling and how to crawl websites with PHP?

Web crawling is automated process where a program is browsing World Wide Web to index data from websites. Examples of web crawlers or web spiders are Googlebot, bingbot and others.