Q.How do I control which pages I want indexed by search engines?
To specify which pages should or should not be indexed by search engines, you can use metatags. Navigate to Marketing → SEO (Global) to configure search engine crawler behavior.
In the Header field, enter your robots metatags. These should take the following form:
<meta name="robots" content="noindex, nofollow">
By default, search engine crawlers will index pages on your website, and will follow links to other pages. The noindex
value prevents robots from indexing the current page, and the nofollow
value prevents robots from following links. If you wish to disable one behavior or the other, you can enter index, nofollow
or noindex, follow
here. More information about robots metatags can be viewed at this page.
Please be aware that robots metatags are simply a request, and do not prevent all robots (particularly malicious ones) from indexing your website. Additionally, links from other pages can cause pages on your website to be indexed on major search engines even when these metatags are applied.