When Google launched its search engine in 1998, it needed information — lots of it.

Its best source?

The rapidly growing internet, with its webpages, websites and content hubs.

Google’s sales pitch to brands was simple: Make your website crawlable — so its bots could reach and index your pages — make your content relevant, and Google will send you traffic.