247COMPASS

Robots Meta Tag

A page-level HTML meta tag controlling search indexing, link following and preview behavior. Learn how it works and what to consider in practice.

Technical SEO & Web Infrastructure

robots meta tag

A robots meta tag in the HTML head can specify noindex or nofollow for an individual page. Additional directives include noimageindex, max-snippet:-1 and notranslate, allowing more precise control over image indexing and previews. If robots.txt blocks the URL, crawlers cannot fetch the page to read its meta instructions. A page using noindex must therefore remain crawlable for the directive to be discovered.

Business applications and impact#

Provides flexible page-level control over indexing and search snippets.

Implementation guidance and considerations#

Do not block crawling of pages whose robots meta instructions need to be read.

Indexing

색인

The process of analyzing retrieved web pages and storing their information in a search engine's index.

Crawling

크롤링

The process through which search crawlers follow links, discover URLs and retrieve new or updated content.

Snippet

스니펫

The brief descriptive preview shown beneath a search-result title and URL.

301 Redirect

301 리디렉션

An HTTP status code indicating a permanent move to a new URL and supporting the transfer of link equity.

302 Redirect

302 리다이렉트

An HTTP response code indicating that a resource is temporarily available at another URL.

Latest insights