In general, your Google crawl rate should be relatively stable over the time span of a week or two; if you see a sudden drop, here are a few possible reasons: You added a new (or very broad) robots.txt rule.

Google crawl rate should be relatively stable over the time span of a week or two; if you see a sudden drop, here are a few possible reasons: You added a new (or very broad) robots.txt rule. Make sure that you are only blocking the resources that you need to.

In general, your Google crawl rate should be relatively stable over the time span of a week or two; if you see a sudden drop, here are a few possible reasons: You added a new (or very broad) robots.txt rule.