In the beginning, site owners submitted the handle of a website page, or URL to the various search engines like google and yahoo, which would send out an online crawler to crawl that web page, extract inbound links to other pages from it, and return details uncovered around the website https://www.youtube.com/watch?v=Tmal7B28Td0