Hello
We are going to allow our vast Confluence help centre site to be indexed by the search engines. We have some Archive spaces but don't want them indexed as its old content.
Will editing robots.txt No Index, No Follow on the top page be enough to stop Google and others indexing an Archived space?
I note:
https://confluence.atlassian.com/doc/archive-a-space-284368719.html
Archiving a space has no effect on search results of external search engines. For example, a public space will still appear in Google search results.
But really wonder why it would be built in to allow something that's archived to be indexed?
Hello there!
As specified in our documentation Julie, even after archived a Space can come up in search engines such as Bing, Google and Yahoo. Since the indexing is not tied to Confluence itself, the application has no control on what the engines index.
We need to configure this manually using a robot.txt file. This should be enough to stop Google and the others from indexing your pages.
I could find documentation from Bing, Google and Yahoo on how to keep them from indexing pages via robots.txt. You can check them here Julie:
Bing - How Can I Get a Page on My Site Out of the Bing Index?
Google - Introduction to robots.txt
Google - Block search indexing with 'noindex'
Yahoo - Why is Slurp crawling my page?
Let us know if this helps you Julie. Looking forward to your reply.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Glad to hear that this helped you Julie! If you need anything else, do not hold back and come straight into the Community.
See you!
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Online forums and learning are now in one easy-to-use experience.
By continuing, you accept the updated Community Terms of Use and acknowledge the Privacy Policy. Your public name, photo, and achievements may be publicly visible and available in search engines.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.