Data recovery assistance

[Paul Costello]

Our production Jira recently crashed.  The root cause of this was that the disk filled up on the postgres db server, causing the system catalog to become corrupted.  Unfortunately, due to an email forwarding discontinuation, we did not become aware of this until 2/26.  The db was corrupted on 1/10.  Jira ran in memory through the intervening period, with no issues, until the server was shut down and the db wouldn't start.

I am a Postgres DBA, not a Java dev.  As such, I am able to recover the database into a consistent state, with Jira down of course.  However the restored db only reflects 1/10 and prior.  The app runs fine on it, other than missing the 47 days of data.

My question is, can I restore this missing data into the restored database from the app files?  Does this data still exist in Jira, on our 2/26 snapshot, perhaps prior to reindexing?

Thanks.  This is a big problem for us.

[Mirek]

That sounds like a bigger problem that requires specific assistance. I do not think that someone here at the community could give you a specific answer on this problem. Technically it should be possible to add something directly to DB (you should know that) but there are many references that could potentially break things. It is better to reach out Atlassian Support directly - https://support.atlassian.com/ for in dept analysis and assistance.

My personal suggestion is to directly not work on DB, just try to recreate the instance somewhere else and if something missing try to merge the data from the UI with PRD environment.  That would be much safer.

[Paul Costello]

Obviously data needs to be added to the db.  The question is, is that data available in and accessible from the application files, or do we somehow need to rebuild with emails?

Atlassian quickly referred us to the community and to Atlassian Solution Partners.  Part of this may have to do with we are using a non-supported version of Jira, though it may have more to do with the level of difficulty.

What I need now is a referral to a good Atlassian Solution Partner, who we are willing to pay, and that might be able to help with such a difficult problem.  Any ideas on finding a really good SP?  There are 40 in the US so I need to narrow it down.

Thanks again. 

[Vickey Palzor Lepcha]

Did you check your JIRA xml backups and tried restoring using that in a new DB.

But well I'm assuming xml would also have only what your DB had back then.

[Paul Costello]

I don't know how to restore Jira XML into the database.  I am a DBA.  That's why I'm asking for help from Atlassian and here.

Interestingly enough, before reindexing the newer issues are referenced in the app, though they can't be clicked.  So they exist somewhere in Jira, or at least references to them exist.

I need a reference to a good Atlassian Service Provider who we can pay to look at this for us, since Atlassian won't.