Crawling & Indexing


Directives inform search engine bots what pages they are allowed to crawl on a website and/or add to a search engine's index. Learn more about the most commonly used directives a website can leverage for search engine optimization benefits.

Learn more about directives


Annotations are signals that can be sent to search engines for them to better understand the structure of a website and how it relates to other pages or files across the internet. Annotations are hints that give an information but not a directive.

Learn more about annotations

Website Configuration

The website's configuration, while under the responsibility of the web developer(s), has major effects on SEO. URL structure, mobile solution implementation but also site latency greatly influence how search engines will rank the site's pages in the SERPs.

Learn more about website configuration