Build robots.txt file to authenticate and quit crawler from crawling everything other than your own home web page. Highlights any problems Google has in crawling and indexing your web site. It’s like getting and correcting problems Which may end Google from exhibiting your web pages. Lets you submit a sitemap https://hellopredict.com