Crawlability/indexability: Your sitemap and robots.txt with each other inform Google Whatever you do and don’t want Google to crawl and index. As an example, our web site generates an estimated 572K visits each month from Google. With no Web optimization, we’d have to invest around $0.5M on advertisements to acquire https://acim.cc