247COMPASS

Crawl Budget

The crawl capacity and demand that determine how many pages search engines fetch over time. Learn how it works and what to consider in practice.

Technical SEO & Web Infrastructure

크롤 버짓

Crawl budget reflects factors including server capacity and demand for a site’s content, with popularity and backlinks contributing to that demand. Large e-commerce or media sites with hundreds of thousands of pages may see new or updated URLs waiting weeks for crawling. Limit unnecessary parameter combinations and improve TTFB so available crawl resources can be spent on more useful pages.

Business applications and impact#

Helps important new and updated content receive timely crawler attention.

Implementation guidance and considerations#

Control unnecessary parameter URLs and improve server response times.

Crawling

크롤링

The process through which search crawlers follow links, discover URLs and retrieve new or updated content.

Backlink

백링크

An inbound link from an external website referencing a page on your website.

301 Redirect

301 리디렉션

An HTTP status code indicating a permanent move to a new URL and supporting the transfer of link equity.

302 Redirect

302 리다이렉트

An HTTP response code indicating that a resource is temporarily available at another URL.

404 Not Found

404 오류

An HTTP client-error status indicating that the requested resource was not found.

Latest insights