Custom Robots Header Tags in Blogger: Safe Settings Explained

By ·

In Blogger's settings, under Crawlers and indexing, there is a switch called Enable custom robots header tags, followed by a list of options such as all, noindex, nofollow, none and noarchive. Many tutorials tell you to tick a long list of boxes. Some of that advice is outdated, and one wrong tick can remove your posts from Google.

This guide explains what each option does, using Google's own documentation, and gives a safe configuration for most blogs. After that, it walks through the other Blogger settings that matter for SEO, from search descriptions to redirects, so your whole blog is set up correctly.

What custom robots header tags are

Robots header tags are instructions to search engines about whether a page may be indexed and how it may appear in results. Blogger adds them to your pages as robots meta tags. With the switch off, Blogger uses its defaults, and for most blogs those defaults are fine. Switching it on lets you set your own values for three groups of pages: the homepage, archive and search pages, and posts and pages.

How to enable custom robots header tags in Blogger

  1. In the Blogger dashboard, open Settings and scroll to Crawlers and indexing.
  2. Turn on Enable custom robots header tags.
  3. Click Home page tags, tick all and save.
  4. Click Archive and search page tags, tick noindex and save.
  5. Click Post and page tags, tick all and save.
  6. Open one post, view the page source and check that it does not contain a robots meta tag with noindex.

Safe custom robots header tag settings

GroupRecommendedWhy
Home pageallLet it be indexed and followed normally
Archive and search pagesnoindexDate archives and search results are thin lists that duplicate your posts
Posts and pagesallYour main content should be indexed

Links on noindexed archive pages can still be followed, so there is no need to add nofollow there.

What each option means

Definitions below follow Google's documentation on robots meta tags.

OptionWhat it doesUse it?
allNo restrictions. This is the default, so it has no effect on its ownYes, for the home page and posts
noindexKeeps the page out of search resultsOnly for archive and search pages, or single pages you want hidden
nofollowAsks search engines not to follow links on the pageRarely; it weakens your internal linking
noneThe same as noindex and nofollow togetherNo, for normal pages
noarchiveAsked for no cached copy. Google says it no longer uses this rule, since its cache feature was removed; Bing documents its own use of itNot needed for most blogs
nosnippetPrevents a text snippet in resultsNo; snippets help people choose your result
noodpReferred to a web directory that closed years agoNo effect today; skip it
notranslateStops Google offering a translation of the page in resultsUsually no
noimageindexStops images on the page being indexedUsually no
unavailable_afterDrops the page from results after a dateOnly for time-limited pages

Mistakes that remove posts from Google

  • Ticking noindex or none under Post and page tags. This tells Google not to index any of your posts.
  • Ticking several options at once because a tutorial listed them, without knowing what they do.
  • Setting noindex on the home page, which can hide your blog's main entry point.
  • Forgetting a per-post noindex left on from testing.

If posts disappear from search after changing these settings, open Pages in Search Console and look for "Excluded by 'noindex' tag".

Other Blogger settings that matter for SEO

The robots header tags are only one part of setting up a blog. The sections below go through the rest of the Blogger settings page in order.

Basic settings

Blog title and description

Under Settings > Basic, set a clear blog title (usually your brand name) and a short description of what the blog covers. Many themes show the description on the homepage and use it in the homepage's meta tags, so write a natural sentence rather than a list of keywords.

Google Analytics

Also under Basic, the Google Analytics Property ID field connects your blog to Google Analytics. Enter your GA4 measurement ID (it starts with G-) if your theme supports it. Analytics helps you see which posts attract readers, which is essential for deciding what to write next.

Privacy and visibility

Under Settings > Privacy, make sure Visible to search engines is switched on. If it is off, Blogger adds a noindex instruction and your blog will not appear in search at all. This setting is sometimes switched off while a blog is being built and forgotten afterwards.

Publishing: custom domain

A custom domain such as www.yourname.com is optional, but it is easier to remember, looks more professional and stays with you if you ever move platforms. Set it under Settings > Publishing > Custom domain after buying a domain from a registrar. Blogger provides the DNS records to add.

After switching, the old blogspot.com address redirects to the new domain, so existing links keep working. Add the new domain as a property in Google Search Console and submit its sitemaps.

HTTPS

Under Settings > HTTPS, switch on both HTTPS availability and HTTPS redirect. Blogger provides free certificates, including for custom domains. With the redirect on, visitors and search engines always reach the secure version, which avoids duplicate http and https URLs. After a new custom domain is added, it can take a little while before the certificate is ready.

Meta tags: enable search descriptions

Under Settings > Meta tags, switch on Enable search description and write a description for the blog's homepage. This unlocks a Search description box in the settings of every post and page, which becomes the meta description. It is off by default, so many Blogger posts have no description at all.

Our guide to writing meta titles and descriptions explains what to write, and the meta tag generator previews how it will look in Google.

Errors and redirects

Custom 404 page

Under Settings > Errors and redirects, you can set a custom message for pages that are not found. A helpful 404 message with a link to your homepage and search box keeps lost visitors on the site.

Custom redirects

If you change a post's URL or delete a post that has a close replacement, add a redirect here from the old path to the new one, and tick Permanent so search engines treat it as a 301 redirect.

Crawlers and indexing

This section has two switches that many tutorials tell you to turn on immediately. Be careful: a mistake here can remove your blog from search.

Custom robots.txt

Blogger's default robots.txt already does the right things: it lets the AdSense crawler see everything, keeps search and label result pages from being crawled, and lists your sitemap. Unless you have a specific reason, leave the custom robots.txt switched off. If you do need one, build and test it with the robots.txt generator using the Blogger preset, and read our robots.txt guide first.

Custom robots header tags

See the first part of this guide for safe settings. Never set noindex on posts and pages unless you want them out of search.

You can also adjust robots tags for an individual post in its settings, under Custom robot tags, for example to noindex a thank-you page.

Per-post settings to use every time

  1. Title. Write a clear, specific title. It becomes the H1 and usually the title tag. Use the title case converter to keep capitalization consistent.
  2. Permalink. Choose Custom permalink and set a short, readable slug before you publish. Changing it later requires a redirect.
  3. Labels. Add one to three labels from a small, consistent set. Labels help readers browse and help you organize topics.
  4. Search description. Write a unique description for each post.
  5. Images. Click each image and fill in its alt text, describing what it shows. Use descriptive file names before uploading.
  6. Headings. Use the editor's Heading and Subheading formats for sections rather than bold text, so the structure is real HTML headings.
  7. Links. Link to two or three related posts or pages on your blog with descriptive anchor text.

After publishing

  • Search Console. Verify the blog in Google Search Console and submit both sitemap.xml and sitemap-pages.xml. Our guide to on-page SEO includes a checklist for each new post.
  • Bing Webmaster Tools. Import your site from Search Console to reach Bing and the search engines it powers.
  • Check the live page. Paste the published post's HTML into the on-page SEO checker to confirm the title, description, headings and alt text are in place.

Theme considerations

Your theme controls a lot of the HTML that search engines see: how titles are written, whether post titles are H1 headings, whether structured data is included and how fast pages load. When choosing a theme, prefer one that is lightweight and well maintained, uses a single H1 per page, and outputs proper meta description and Open Graph tags. Before switching themes on an established blog, back up the current theme from Theme > Backup.

FAQ

Can a Blogger blog rank as well as a WordPress site?

Yes. Search engines rank pages, not platforms. Content quality, relevance and links matter far more than which software publishes the page.

Should I enable custom robots header tags in Blogger?

You do not have to. Blogger's defaults are reasonable. If you enable them, use the safe settings above: all for the home page and posts, noindex for archive and search pages.

Should I noindex label pages?

Blogger's default robots.txt already blocks crawling of /search URLs, which include label pages, so most blogs do not need extra settings for them.

Why are my posts not showing on Google?

Check that Visible to search engines is on, that you have not set noindex on posts, and that your sitemaps are submitted. Then use the URL Inspection tool in Search Console. New blogs can take time to be crawled and indexed.

Conclusion

Blogger's defaults are mostly sound. Switch on HTTPS and search descriptions, keep visibility on, set archive and search pages to noindex if you use custom header tags, leave robots.txt alone unless you have a reason, and use permalinks, descriptions, labels and alt text on every post. With the settings right, your time is best spent on what really drives traffic: helpful posts that answer what your readers are searching for.

Want keyword ideas for your own topic? Use the free keyword research tool → or browse all free SEO tools.

Comments