Crawl Budget
How many pages Google will crawl on your site per day.
What it means
Crawl budget is the number of pages a search engine will crawl on your site within a given timeframe. It’s the combination of crawl rate limit (server capacity) and crawl demand (how much Google wants your URLs).
How it affects your SEO
On large sites, wasted crawl budget on thin, duplicate, or parameter URLs means your important pages may be crawled less often and rank slower. Pruning low-value URLs and managing internal links keeps crawl budget focused where it earns rankings.
Crawl Budget — frequently asked questions
Do small sites need to worry about crawl budget?
Usually no. Crawl budget is mainly a concern for large sites (tens of thousands of URLs). For small sites, Google can crawl everything easily and the lever is irrelevant.
How do I improve crawl budget?
Prune thin, duplicate, and parameter URLs, fix broken links, manage internal links, and use robots.txt to keep crawlers off low-value paths so budget goes to important pages.
Related SEO terms
Tells Google which version of a page is the “real” one when duplicates exist.
Google’s three speed-and-stability metrics: LCP, INP, and CLS.
Structured data that labels content (reviews, FAQ, products) for search engines.
A file that tells crawlers what they may and may not crawl.
Is this hurting your rankings?
Run a free 60-second audit and find out where crawl budget — and dozens of other factors — stand on your site.
Get my free SEO score