Technical SEO

Crawl Budget

Quick Definition

Crawl budget is the number of URLs Googlebot will crawl on your site in a given timeframe. It only matters for large sites (10,000+ URLs) or sites with crawl waste from parameters.

In context

Most small business sites under 1,000 pages will never bump up against crawl budget limits. Optimize crawl budget by blocking parameter URLs in robots.txt, fixing redirect chains, and improving server response time.

Have a question this didn't answer?

Book a free 60-minute strategy call. We'll explain how this concept applies to your specific situation.

Book a Free Call Browse 50+ Detailed Answers

Related terms

HTTP/3 (QUIC)

HTTP/3 is the third major version of HTTP, built on QUIC (UDP-based) instead of TCP, eliminating head-of-line blocking and reducing connection-setup latency.

LCP (Largest Contentful Paint)

LCP measures how fast the largest visible element on the page loads. The 'good' threshold is under 2.5 seconds for 75% of users.

SSR (Server-Side Rendering)

SSR generates HTML on the server before sending it to the browser, ensuring search engines see complete content immediately.

Breadcrumbs

Breadcrumbs are a navigation trail (Home > Category > Subcategory > Page) that shows the user's location in the site hierarchy.

Sitemap

A sitemap is a file that lists URLs on a site so search engines can discover and prioritise crawling. The most common format is XML; HTML sitemaps exist for human navigation.

308 Permanent Redirect

A 308 status code is a permanent HTTP redirect that preserves the original request method, the modern method-preserving alternative to 301.

Back to all terms