JIRA has been locked - SQL Exception

[Stephen]

We recently had to redeploy a Kubernetes hosted Jira service (9.12.7) using PostgreSQL. Upon redeployment we are receiving SQL Exception complaining about non-existent relations. When this occurs, a locked error is also present. We tried clearing the lock based on [1] but that did not help. Thought on how to fix the relation issues?

[1] https://confluence.atlassian.com/jirakb/jira-has-been-locked-error-when-starting-jira-server-or-data-center-224400783.html

INFO:root:Generating /etc/container_id from template container_id.j2 INFO:root:Generating /opt/atlassian/jira/conf/server.xml from template server.xml.j2 INFO:root:Generating /opt/atlassian/jira/atlassian-jira/WEB-INF/classes/seraph-config.xml from template seraph-config.xml.j2 INFO:root:/var/atlassian/application-data/jira/dbconfig.xml exists; skipping. INFO:root:Generating /var/atlassian/application-data/jira/cluster.properties from template cluster.properties.j2 INFO:root:User is currently root. Will downgrade run user to jira WARNING:root:Unsetting environment var ATL_JDBC_PASSWORD INFO:root:Running Jira with command '/opt/atlassian/jira/bin/start-jira.sh', arguments ['/opt/atlassian/jira/bin/start-jira.sh', '-fg'] executing as current user `sMMMMMMMMMMMMMM+ MMMMMMMMMMMMMM :sdMMMMMMMMMMM MMMMMM `sMMMMMMMMMMMMMM+ MMMMMM MMMMMMMMMMMMMM +MMMMM :sMMMMMMMMMMM MMMMM MMMMMM `UOJ `sMMMMMMMMMMMMM+ MMMMMM MMMMMMMMMMMMMM +MMMMM :sdMMMMMMMMMM MMMMM MMMMMM `UOJ MMMMMM +MMMMM MMMMM `UOJ Atlassian Jira Version : 9.12.7 If you encounter issues starting or stopping Jira, please see the Troubleshooting guide at https://docs.atlassian.com/jira/jadm-docs-0912/Troubleshooting+installation Using JIRA_HOME: /var/atlassian/application-data/jira Server startup logs are located in /opt/atlassian/jira/logs/catalina.out NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 02-Mar-2025 12:57:59.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.87 02-Mar-2025 12:57:59.899 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Mar 11 2024 10:12:34 UTC 02-Mar-2025 12:57:59.899 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.87.0 02-Mar-2025 12:57:59.899 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 02-Mar-2025 12:57:59.899 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.10.230-223.885.amzn2.x86_64 02-Mar-2025 12:57:59.900 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 02-Mar-2025 12:57:59.900 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /opt/java/openjdk 02-Mar-2025 12:57:59.900 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 11.0.26+4 02-Mar-2025 12:57:59.900 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Eclipse Adoptium 02-Mar-2025 12:57:59.900 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /opt/atlassian/jira 02-Mar-2025 12:57:59.900 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /opt/atlassian/jira 02-Mar-2025 12:57:59.906 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/opt/atlassian/jira/conf/logging.properties 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms384m 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx768m 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:InitialCodeCacheSize=32m 02-Mar-2025 12:57:59.907 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:ReservedCodeCacheSize=512m 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dlog4j2.contextSelector=org.apache.logging.log4j.core.selector.BasicContextSelector 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dlog4j2.disableJmx=true 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dlog4j2.garbagefree.threadContextMap=true 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dlog4j2.isWebapp=false 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.awt.headless=true 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Datlassian.standalone=JIRA 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.jasper.runtime.BodyContentImpl.LIMIT_BUFFER=true 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dmail.mime.decodeparameters=true 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.dom4j.factory=com.atlassian.core.xml.InterningDocumentFactory 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Datlassian.logging.cloud.enabled=false 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStore=/var/atlassian/application-data/shared-home/cacerts 02-Mar-2025 12:57:59.908 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.atlassian.jira.status.index.check=false 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:ActiveProcessorCount=2 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStore=/var/ssl/cacerts 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:-OmitStackTraceInFastThrow 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.locale.providers=COMPAT 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djira.home=/var/atlassian/application-data/jira 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Datlassian.plugins.startup.options=-fg 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xlog:gc*:file=/opt/atlassian/jira/logs/atlassian-jira-gc-%t.log:tags,time,uptime,level:filecount=5,filesize=20M 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:+ExplicitGCInvokesConcurrent 02-Mar-2025 12:57:59.909 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs= 02-Mar-2025 12:57:59.910 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/opt/atlassian/jira 02-Mar-2025 12:57:59.910 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/opt/atlassian/jira 02-Mar-2025 12:57:59.910 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/opt/atlassian/jira/temp 02-Mar-2025 12:57:59.911 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The Apache Tomcat Native library which allows using OpenSSL was not found on the java.library.path: [/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib] 02-Mar-2025 12:58:00.161 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"] 02-Mar-2025 12:58:00.170 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [480] milliseconds 02-Mar-2025 12:58:00.194 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 02-Mar-2025 12:58:00.194 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.87] 2025-03-02 12:58:02,865+0000 main INFO [c.a.jira.startup.JiraHomeStartupCheck] The jira.home directory '/var/atlassian/application-data/jira' is validated and locked for exclusive use by this instance. 2025-03-02 12:58:02,900+0000 main INFO [c.a.jira.startup.JiraStartupLogger] **************** Jira starting... **************** 2025-03-02 12:58:02,946+0000 main INFO [c.a.jira.startup.JiraStartupLogger] ___ Environment _____________________________ JIRA Build : 9.12.7#9120007-sha1:77878f28c5a5673469d81b7d9f14744ca4b2ad1e Build Date : Thu Apr 11 00:00:00 UTC 2024 JIRA Installation Type : Standalone Application Server : Apache Tomcat/9.0.87 - Servlet API 4.0 Java Version : 11.0.26 - Eclipse Adoptium Current Working Directory : /var/atlassian/application-data/jira Maximum Allowable Memory : 768MB Total Memory : 386MB Free Memory : 250MB Used Memory : 136MB Memory Pool: CodeHeap 'non-nmethods' : CodeHeap 'non-nmethods': init = 5828608(5692K) used = 1316224(1285K) committed = 5828608(5692K) max = 5828608(5692K) Memory Pool: Metaspace : Metaspace: init = 0(0K) used = 25767544(25163K) committed = 26869760(26240K) max = -1(-1K) Memory Pool: CodeHeap 'profiled nmethods' : CodeHeap 'profiled nmethods': init = 33554432(32768K) used = 9366016(9146K) committed = 33554432(32768K) max = 265519104(259296K) Memory Pool: Compressed Class Space : Compressed Class Space: init = 0(0K) used = 2836840(2770K) committed = 3276800(3200K) max = 1073741824(1048576K) Memory Pool: G1 Eden Space : G1 Eden Space: init = 20971520(20480K) used = 105906176(103424K) committed = 247463936(241664K) max = -1(-1K) Memory Pool: G1 Old Gen : G1 Old Gen: init = 381681664(372736K) used = 27833856(27181K) committed = 150994944(147456K) max = 805306368(786432K) Memory Pool: G1 Survivor Space : G1 Survivor Space: init = 0(0K) used = 6291456(6144K) committed = 6291456(6144K) max = -1(-1K) Memory Pool: CodeHeap 'non-profiled nmethods' : CodeHeap 'non-profiled nmethods': init = 33554432(32768K) used = 1997952(1951K) committed = 33554432(32768K) max = 265523200(259300K) JVM Input Arguments : --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED -Djava.util.logging.config.file=/opt/atlassian/jira/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Xms384m -Xmx768m -XX:InitialCodeCacheSize=32m -XX:ReservedCodeCacheSize=512m -Dlog4j2.contextSelector=org.apache.logging.log4j.core.selector.BasicContextSelector -Dlog4j2.disableJmx=true -Dlog4j2.garbagefree.threadContextMap=true -Dlog4j2.isWebapp=false -Djava.awt.headless=true -Datlassian.standalone=JIRA -Dorg.apache.jasper.runtime.BodyContentImpl.LIMIT_BUFFER=true -Dmail.mime.decodeparameters=true -Dorg.dom4j.factory=com.atlassian.core.xml.InterningDocumentFactory -Datlassian.logging.cloud.enabled=false -Djavax.net.ssl.trustStore=/var/atlassian/application-data/shared-home/cacerts -Dcom.atlassian.jira.status.index.check=false -XX:ActiveProcessorCount=2 -Djavax.net.ssl.trustStore=/var/ssl/cacerts -XX:-OmitStackTraceInFastThrow -Djava.locale.providers=COMPAT -Djira.home=/var/atlassian/application-data/jira -Datlassian.plugins.startup.options=-fg -Djdk.tls.ephemeralDHKeySize=2048 -Djava.protocol.handler.pkgs=org.apache.catalina.webresources -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 -Xlog:gc*:file=/opt/atlassian/jira/logs/atlassian-jira-gc-%t.log:tags,time,uptime,level:filecount=5,filesize=20M -XX:+ExplicitGCInvokesConcurrent -Dignore.endorsed.dirs= -Dcatalina.base=/opt/atlassian/jira -Dcatalina.home=/opt/atlassian/jira -Djava.io.tmpdir=/opt/atlassian/jira/temp Java Compatibility Information : JIRA version = 9.12.7, Java Version = 11.0.26 ___ Java System Properties _________________ atlassian.logging.cloud.enabled : false atlassian.plugins.startup.options : -fg atlassian.standalone : JIRA awt.toolkit : sun.awt.X11.XToolkit catalina.base : /opt/atlassian/jira catalina.home : /opt/atlassian/jira catalina.useNaming : true com.atlassian.jira.status.index.check : false common.loader : "${catalina.base}/lib", "${catalina.base}/lib/*.jar", "${catalina.home}/lib", "${catalina.home}/lib/*.jar" file.encoding : UTF-8 ignore.endorsed.dirs : java.awt.graphicsenv : sun.awt.X11GraphicsEnvironment java.awt.headless : true java.awt.printerjob : sun.print.PSPrinterJob java.class.version : 55.0 java.home : /opt/java/openjdk java.io.tmpdir : /opt/atlassian/jira/temp java.locale.providers : COMPAT java.naming.factory.initial : org.apache.naming.java.javaURLContextFactory java.naming.factory.url.pkgs : org.apache.naming java.protocol.handler.pkgs : org.apache.catalina.webresources java.runtime.name : OpenJDK Runtime Environment java.runtime.version : 11.0.26+4 java.specification.maintenance.version : 3 java.specification.name : Java Platform API Specification java.specification.vendor : Oracle Corporation java.specification.version : 11 java.util.logging.config.file : /opt/atlassian/jira/conf/logging.properties java.util.logging.manager : org.apache.juli.ClassLoaderLogManager java.vendor : Eclipse Adoptium java.vendor.url : https://adoptium.net/ java.vendor.url.bug : https://github.com/adoptium/adoptium-support/issues java.vendor.version : Temurin-11.0.26+4 java.version : 11.0.26 java.version.date : 2025-01-21 java.vm.compressedOopsMode : 32-bit java.vm.info : mixed mode, sharing java.vm.name : OpenJDK 64-Bit Server VM java.vm.specification.name : Java Virtual Machine Specification java.vm.specification.vendor : Oracle Corporation java.vm.specification.version : 11 java.vm.vendor : Eclipse Adoptium java.vm.version : 11.0.26+4 javax.net.ssl.trustStore : /var/ssl/cacerts jdk.debug : release jdk.tls.ephemeralDHKeySize : 2048 jira.home : /var/atlassian/application-data/jira log4j2.contextSelector : org.apache.logging.log4j.core.selector.BasicContextSelector log4j2.disableJmx : true log4j2.garbagefree.threadContextMap : true log4j2.isWebapp : false mail.mime.decodeparameters : true org.apache.catalina.security.SecurityListener.UMASK : 0027 org.apache.el.GET_CLASSLOADER_USE_PRIVILEGED : false org.apache.jasper.runtime.BodyContentImpl.LIMIT_BUFFER : true org.dom4j.factory : com.atlassian.core.xml.InterningDocumentFactory os.arch : amd64 os.name : Linux os.version : 5.10.230-223.885.amzn2.x86_64 package.access : sun., org.apache.catalina., org.apache.coyote., org.apache.jasper., org.apache.tomcat. package.definition : sun., java., org.apache.catalina., org.apache.coyote., org.apache.jasper., org.apache.naming., org.apache.tomcat. server.loader : shared.loader : sun.arch.data.model : 64 sun.boot.library.path : /opt/java/openjdk/lib sun.cpu.endian : little sun.cpu.isalist : sun.io.unicode.encoding : UnicodeLittle sun.java.command : org.apache.catalina.startup.Bootstrap start sun.java.launcher : SUN_STANDARD sun.jnu.encoding : UTF-8 sun.management.compiler : HotSpot 64-Bit Tiered Compilers sun.os.patch.level : unknown tomcat.util.buf.StringCache.byte.enabled : true tomcat.util.scan.StandardJarScanFilter.jarsToScan : log4j-taglib*.jar, log4j-web*.jar, log4javascript*.jar, slf4j-taglib*.jar tomcat.util.scan.StandardJarScanFilter.jarsToSkip : annotations-api.jar, ant-junit*.jar, ant-launcher*.jar, ant*.jar, asm-*.jar, aspectj*.jar, bcel*.jar, biz.aQute.bnd*.jar, bootstrap.jar, catalina-ant.jar, catalina-ha.jar, catalina-ssi.jar, catalina-storeconfig.jar, catalina-tribes.jar, catalina.jar, cglib-*.jar, cobertura-*.jar, commons-beanutils*.jar, commons-codec*.jar, commons-collections*.jar, commons-compress*.jar, commons-daemon.jar, commons-dbcp*.jar, commons-digester*.jar, commons-fileupload*.jar, commons-httpclient*.jar, commons-io*.jar, commons-lang*.jar, commons-logging*.jar, commons-math*.jar, commons-pool*.jar, derby-*.jar, dom4j-*.jar, easymock-*.jar, ecj-*.jar, el-api.jar, geronimo-spec-jaxrpc*.jar, h2*.jar, ha-api-*.jar, hamcrest-*.jar, hibernate*.jar, httpclient*.jar, icu4j-*.jar, jasper-el.jar, jasper.jar, jaspic-api.jar, jaxb-*.jar, jaxen-*.jar, jaxws-rt-*.jar, jdom-*.jar, jetty-*.jar, jmx-tools.jar, jmx.jar, jsp-api.jar, jstl.jar, jta*.jar, junit-*.jar, junit.jar, log4j*.jar, mail*.jar, objenesis-*.jar, oraclepki.jar, org.hamcrest.core_*.jar, org.junit_*.jar, oro-*.jar, servlet-api-*.jar, servlet-api.jar, slf4j*.jar, taglibs-standard-spec-*.jar, tagsoup-*.jar, tomcat-api.jar, tomcat-coyote.jar, tomcat-dbcp.jar, tomcat-i18n-*.jar, tomcat-jdbc.jar, tomcat-jni.jar, tomcat-juli-adapters.jar, tomcat-juli.jar, tomcat-util-scan.jar, tomcat-util.jar, tomcat-websocket.jar, tools.jar, unboundid-ldapsdk-*.jar, websocket-api.jar, wsdl4j*.jar, xercesImpl.jar, xml-apis.jar, xmlParserAPIs-*.jar, xmlParserAPIs.jar, xom-*.jar user.country : US user.dir : /var/atlassian/application-data/jira user.home : /var/atlassian/application-data/jira user.language : en user.name : jira user.timezone : Etc/UTC 2025-03-02 12:58:02,953+0000 main INFO [c.a.jira.startup.TemporaryDirectoryCleaner] Cleaning the temporary directory located at /opt/atlassian/jira/temp 2025-03-02 12:58:02,954+0000 main INFO [c.a.jira.startup.TemporaryDirectoryCleaner] Finished cleaning the temporary directory. 2025-03-02 12:58:03,088+0000 main INFO [c.a.j.config.database.SystemDatabaseConfigurationLoader] Reading database configuration from /var/atlassian/application-data/jira/dbconfig.xml 2025-03-02 12:58:03,109+0000 main INFO [c.a.j.config.database.DatabaseConfigHandler] Trying to get encrypted password from xml and decrypt it 2025-03-02 12:58:03,110+0000 main INFO [c.atlassian.secrets.DefaultSecretStoreProvider] Initiating secret store class: null 2025-03-02 12:58:03,110+0000 main INFO [c.a.j.config.database.DatabaseConfigHandler] Database password decryption not performed. 2025-03-02 12:58:03,334+0000 main INFO [c.a.jira.startup.JiraStartupLogger] Running Jira startup checks. 2025-03-02 12:58:03,335+0000 main INFO [c.a.jira.startup.JiraStartupLogger] Jira pre-database startup checks completed successfully. 2025-03-02 12:58:03,926+0000 main INFO [c.a.j.config.database.DatabaseConfigurationManagerImpl] The database is configured. Now running Database Checklist Launcher 2025-03-02 12:58:03,928+0000 main INFO [c.a.jira.startup.DatabaseChecklistLauncher] Jira database startup checks completed successfully. 2025-03-02 12:58:03,929+0000 main INFO [c.a.j.config.database.DatabaseConfigurationManagerImpl] The database is configured. Now running Post database-configuration launchers 2025-03-02 12:58:04,950+0000 main INFO [c.a.j.config.database.SystemDatabaseConfigurationLoader] Reading database configuration from /var/atlassian/application-data/jira/dbconfig.xml 2025-03-02 12:58:04,952+0000 main INFO [c.a.j.config.database.DatabaseConfigHandler] Trying to get encrypted password from xml and decrypt it 2025-03-02 12:58:04,952+0000 main INFO [c.atlassian.secrets.DefaultSecretStoreProvider] Initiating secret store class: null 2025-03-02 12:58:04,952+0000 main INFO [c.a.j.config.database.DatabaseConfigHandler] Database password decryption not performed. 2025-03-02 12:58:05,017+0000 main ERROR [c.a.jira.startup.ComponentContainerLauncher] A fatal error occurred during initialisation. JIRA has been locked. net.sf.ehcache.CacheException: java.lang.IllegalStateException: Unable to resolve component: interface com.atlassian.jira.cluster.ClusterManager at net.sf.ehcache.CacheManager.init(CacheManager.java:426) at net.sf.ehcache.CacheManager.(CacheManager.java:270) at net.sf.ehcache.CacheManager.newInstance(CacheManager.java:1116) at net.sf.ehcache.CacheManager.newInstance(CacheManager.java:1092) at com.atlassian.jira.component.pico.registrar.CacheManagerRegistrar.getCacheManagerDelegate(CacheManagerRegistrar.java:279) at com.atlassian.jira.component.pico.registrar.CacheManagerRegistrar.registerCacheManager(CacheManagerRegistrar.java:164) at com.atlassian.jira.component.pico.registrar.ContainerRegistrar.registerCacheManager(ContainerRegistrar.java:4266) at com.atlassian.jira.component.pico.registrar.ContainerRegistrar.registerComponents(ContainerRegistrar.java:4211) at com.atlassian.jira.component.pico.ComponentManager.createFullContainer(ComponentManager.java:212) at com.atlassian.jira.startup.ComponentContainerLauncher.populateFullPicoContainer(ComponentContainerLauncher.java:50) at com.atlassian.jira.startup.ComponentContainerLauncher.start(ComponentContainerLauncher.java:30) at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$postDbLaunch$2(DefaultJiraLauncher.java:144) at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.doNowOrEnqueue(DatabaseConfigurationManagerImpl.java:305) at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.doNowOrWhenDatabaseActivated(DatabaseConfigurationManagerImpl.java:202) at com.atlassian.jira.startup.DefaultJiraLauncher.postDbLaunch(DefaultJiraLauncher.java:141) at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$start$0(DefaultJiraLauncher.java:107) at com.atlassian.jira.util.devspeed.JiraDevSpeedTimer.run(JiraDevSpeedTimer.java:31) at com.atlassian.jira.startup.DefaultJiraLauncher.start(DefaultJiraLauncher.java:105) at com.atlassian.jira.startup.LauncherContextListener.initSlowStuff(LauncherContextListener.java:154) at com.atlassian.jira.startup.LauncherContextListener.initSlowStuffInBackground(LauncherContextListener.java:139) at com.atlassian.jira.startup.LauncherContextListener.contextInitialized(LauncherContextListener.java:101) ... 5 filtered at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140) ... 5 filtered at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140) ... 8 filtered at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) ... 2 filtered Caused by: java.lang.IllegalStateException: Unable to resolve component: interface com.atlassian.jira.cluster.ClusterManager at com.atlassian.jira.component.ComponentAccessorWorker.getComponent(ComponentAccessorWorker.java:50) at com.atlassian.jira.component.ComponentAccessor.getComponent(ComponentAccessor.java:177) at com.atlassian.jira.component.ComponentReference.get(ComponentReference.java:57) at com.atlassian.jira.cluster.distribution.JiraCacheManagerPeerProvider.getClusterManager(JiraCacheManagerPeerProvider.java:156) at com.atlassian.jira.cluster.distribution.JiraCacheManagerPeerProvider.listRemoteCachePeers(JiraCacheManagerPeerProvider.java:71) ... 2 filtered at net.sf.ehcache.distribution.RMIBootstrapCacheLoader.listRemoteCachePeers(RMIBootstrapCacheLoader.java:245) at net.sf.ehcache.distribution.RMIBootstrapCacheLoader.acquireCachePeers(RMIBootstrapCacheLoader.java:198) at net.sf.ehcache.distribution.RMIBootstrapCacheLoader.doLoad(RMIBootstrapCacheLoader.java:132) at net.sf.ehcache.distribution.RMIBootstrapCacheLoader.load(RMIBootstrapCacheLoader.java:77) at net.sf.ehcache.Cache.bootstrap(Cache.java:1480) at net.sf.ehcache.CacheManager.initializeEhcache(CacheManager.java:1381) at net.sf.ehcache.CacheManager.addCacheNoCheck(CacheManager.java:1436) at net.sf.ehcache.CacheManager.addConfiguredCaches(CacheManager.java:832) at net.sf.ehcache.CacheManager.doInit(CacheManager.java:500) at net.sf.ehcache.CacheManager.init(CacheManager.java:395) ... 50 more Caused by: io.atlassian.util.concurrent.LazyReference$InitializationException: com.atlassian.jira.exception.DataAccessException: org.ofbiz.core.entity.GenericDataSourceException: SQL Exception while executing the following:SELECT NODE_STATE, TIMESTAMP, IP, CACHE_LISTENER_PORT, NODE_BUILD_NUMBER, NODE_VERSION FROM jira.clusternode WHERE NODE_ID=? (ERROR: relation "jira.clusternode" does not exist Position: 93) at io.atlassian.util.concurrent.LazyReference.getInterruptibly(LazyReference.java:156) at io.atlassian.util.concurrent.LazyReference.get(LazyReference.java:116) at io.atlassian.util.concurrent.ResettableLazyReference.get(ResettableLazyReference.java:95) at com.atlassian.jira.cluster.DefaultClusterNodes.current(DefaultClusterNodes.java:60) at com.atlassian.jira.cluster.OfBizMessageHandlerService.getCurrentNode(OfBizMessageHandlerService.java:117) at com.atlassian.jira.cluster.OfBizMessageHandlerService.(OfBizMessageHandlerService.java:66) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490) at org.picocontainer.injectors.AbstractInjector.newInstance(AbstractInjector.java:145) at org.picocontainer.injectors.ConstructorInjector$1.run(ConstructorInjector.java:342) at org.picocontainer.injectors.AbstractInjector$ThreadLocalCyclicDependencyGuard.observe(AbstractInjector.java:270) at org.picocontainer.injectors.ConstructorInjector.getComponentInstance(ConstructorInjector.java:364) at org.picocontainer.behaviors.AbstractBehavior.getComponentInstance(AbstractBehavior.java:64) at org.picocontainer.behaviors.Stored.getComponentInstance(Stored.java:91) at org.picocontainer.behaviors.AbstractBehavior.getComponentInstance(AbstractBehavior.java:64) at com.atlassian.jira.component.pico.behaviors.ContainerSynchronizedBehavior.getComponentInstance(ContainerSynchronizedBehavior.java:25) at org.picocontainer.DefaultPicoContainer.getInstance(DefaultPicoContainer.java:698) at org.picocontainer.DefaultPicoContainer.getComponent(DefaultPicoContainer.java:646) at org.picocontainer.DefaultPicoContainer.getComponent(DefaultPicoContainer.java:631) at org.picocontainer.parameters.BasicComponentParameter$1.resolveInstance(BasicComponentParameter.java:118) at org.picocontainer.parameters.ComponentParameter$1.resolveInstance(ComponentParameter.java:136) at org.picocontainer.injectors.SingleMemberInjector.getParameter(SingleMemberInjector.java:78) at org.picocontainer.injectors.ConstructorInjector$CtorAndAdapters.getParameterArguments(ConstructorInjector.java:309) at org.picocontainer.injectors.ConstructorInjector$1.run(ConstructorInjector.java:335) at org.picocontainer.injectors.AbstractInjector$ThreadLocalCyclicDependencyGuard.observe(AbstractInjector.java:270) at org.picocontainer.injectors.ConstructorInjector.getComponentInstance(ConstructorInjector.java:364) at org.picocontainer.behaviors.AbstractBehavior.getComponentInstance(AbstractBehavior.java:64) at org.picocontainer.behaviors.Stored.getComponentInstance(Stored.java:91) at org.picocontainer.behaviors.AbstractBehavior.getComponentInstance(AbstractBehavior.java:64) at com.atlassian.jira.component.pico.behaviors.ContainerSynchronizedBehavior.getComponentInstance(ContainerSynchronizedBehavior.java:25) at org.picocontainer.behaviors.AbstractBehavior.getComponentInstance(AbstractBehavior.java:64) at org.picocontainer.behaviors.AbstractBehavior.getComponentInstance(AbstractBehavior.java:64) at org.picocontainer.behaviors.Stored.getComponentInstance(Stored.java:91) at org.picocontainer.behaviors.AbstractBehavior.getComponentInstance(AbstractBehavior.java:64) at com.atlassian.jira.component.pico.behaviors.ContainerSynchronizedBehavior.getComponentInstance(ContainerSynchronizedBehavior.java:25) at org.picocontainer.DefaultPicoContainer.getInstance(DefaultPicoContainer.java:698) at org.picocontainer.DefaultPicoContainer.getComponent(DefaultPicoContainer.java:646) at org.picocontainer.DefaultPicoContainer.getComponent(DefaultPicoContainer.java:677) at com.atlassian.jira.component.pico.CachingMutablePicoContainer.getComponent(CachingMutablePicoContainer.java:139) at com.atlassian.jira.component.pico.ComponentContainer.getComponent(ComponentContainer.java:556) at com.atlassian.jira.component.pico.ComponentManager.lambda$maybeGetComponent$3(ComponentManager.java:480) at java.base/java.util.Optional.map(Optional.java:265) at com.atlassian.jira.component.pico.ComponentManager.maybeGetComponent(ComponentManager.java:480) at com.atlassian.jira.component.pico.ComponentManager.getComponent(ComponentManager.java:468) at com.atlassian.jira.component.ComponentAccessorWorker.getComponent(ComponentAccessorWorker.java:48) ... 64 more Caused by: com.atlassian.jira.exception.DataAccessException: org.ofbiz.core.entity.GenericDataSourceException: SQL Exception while executing the following:SELECT NODE_STATE, TIMESTAMP, IP, CACHE_LISTENER_PORT, NODE_BUILD_NUMBER, NODE_VERSION FROM jira.clusternode WHERE NODE_ID=? (ERROR: relation "jira.clusternode" does not exist Position: 93) at com.atlassian.jira.ofbiz.DefaultOfBizDelegator.findByPrimaryKey(DefaultOfBizDelegator.java:343) at com.atlassian.jira.ofbiz.WrappingOfBizDelegator.findByPrimaryKey(WrappingOfBizDelegator.java:203) at com.atlassian.jira.cluster.OfBizClusterNodeStore.getNode(OfBizClusterNodeStore.java:91) at com.atlassian.jira.cluster.DefaultClusterNodes.getOrCreateNode(DefaultClusterNodes.java:95) at com.atlassian.jira.cluster.DefaultClusterNodes.initializeNode(DefaultClusterNodes.java:84) at com.atlassian.jira.cluster.DefaultClusterNodes$1.create(DefaultClusterNodes.java:36) at com.atlassian.jira.cluster.DefaultClusterNodes$1.create(DefaultClusterNodes.java:33) at io.atlassian.util.concurrent.ResettableLazyReference$InternalReference.create(ResettableLazyReference.java:185) at io.atlassian.util.concurrent.LazyReference$Sync.run(LazyReference.java:332) at io.atlassian.util.concurrent.LazyReference.getInterruptibly(LazyReference.java:150) ... 110 more Caused by: org.ofbiz.core.entity.GenericDataSourceException: SQL Exception while executing the following:SELECT NODE_STATE, TIMESTAMP, IP, CACHE_LISTENER_PORT, NODE_BUILD_NUMBER, NODE_VERSION FROM jira.clusternode WHERE NODE_ID=? (ERROR: relation "jira.clusternode" does not exist Position: 93) at org.ofbiz.core.entity.jdbc.SQLProcessor.executeQuery(SQLProcessor.java:549) at org.ofbiz.core.entity.GenericDAO.select(GenericDAO.java:627) at org.ofbiz.core.entity.GenericDAO.select(GenericDAO.java:596) at org.ofbiz.core.entity.GenericHelperDAO.findByPrimaryKey(GenericHelperDAO.java:105) at org.ofbiz.core.entity.GenericDelegator.findByPrimaryKey(GenericDelegator.java:621) at org.ofbiz.core.entity.GenericDelegator.findByPrimaryKey(GenericDelegator.java:659) at com.atlassian.jira.ofbiz.DefaultOfBizDelegator.findByPrimaryKey(DefaultOfBizDelegator.java:341) ... 119 more Caused by: org.postgresql.util.PSQLException: ERROR: relation "jira.clusternode" does not exist Position: 93 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2725) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2412) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:371) at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:502) at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:419) at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:194) at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:137) at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:122) at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:122) at org.ofbiz.core.entity.jdbc.SQLProcessor.executeQuery(SQLProcessor.java:543) ... 125 more 2025-03-02 12:58:05,036+0000 main INFO [c.a.jira.startup.DatabaseLauncher] Database transactions enabled: true 2025-03-02 12:58:05,036+0000 main INFO [c.a.jira.startup.DatabaseLauncher] Using JIRA's default for database transaction isolation level: 2 2025-03-02 12:58:05,042+0000 main WARN [c.a.jira.startup.DatabaseLauncher] JRADEV-23357: unable to select from the 'MovedIssueKey' entity. 2025-03-02 12:58:05,047+0000 main ERROR [c.a.jira.startup.LauncherContextListener] Unable to start JIRA. java.lang.IllegalStateException: Need to rename the MOVED_ISSUE_KEY table, but there is existing data in it. Please contact Atlassian Support. at com.atlassian.jira.startup.DatabaseLauncher.cleanupDatabaseTableName(DatabaseLauncher.java:214) at com.atlassian.jira.startup.DatabaseLauncher.cleanupDatabaseTableNames(DatabaseLauncher.java:178) at com.atlassian.jira.startup.DatabaseLauncher.start(DatabaseLauncher.java:70) at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$postDbLaunch$2(DefaultJiraLauncher.java:145) at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.doNowOrEnqueue(DatabaseConfigurationManagerImpl.java:305) at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.doNowOrWhenDatabaseActivated(DatabaseConfigurationManagerImpl.java:202) at com.atlassian.jira.startup.DefaultJiraLauncher.postDbLaunch(DefaultJiraLauncher.java:141) at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$start$0(DefaultJiraLauncher.java:107) at com.atlassian.jira.util.devspeed.JiraDevSpeedTimer.run(JiraDevSpeedTimer.java:31) at com.atlassian.jira.startup.DefaultJiraLauncher.start(DefaultJiraLauncher.java:105) at com.atlassian.jira.startup.LauncherContextListener.initSlowStuff(LauncherContextListener.java:154) at com.atlassian.jira.startup.LauncherContextListener.initSlowStuffInBackground(LauncherContextListener.java:139) at com.atlassian.jira.startup.LauncherContextListener.contextInitialized(LauncherContextListener.java:101) ... 5 filtered at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140) ... 5 filtered at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140) ... 8 filtered at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) ... 2 filtered 2025-03-02 12:58:05,049+0000 main INFO [c.a.jira.startup.LauncherContextListener] Startup is complete. Jira is ready to serve. 2025-03-02 12:58:05,050+0000 main INFO [c.a.jira.startup.LauncherContextListener] Memory Usage: --------------------------------------------------------------------------------- Heap memory : Used: 193 MiB. Committed: 386 MiB. Max: 768 MiB Non-heap memory : Used: 79 MiB. Committed: 132 MiB. Max: 1536 MiB --------------------------------------------------------------------------------- TOTAL : Used: 272 MiB. Committed: 518 MiB. Max: 2304 MiB --------------------------------------------------------------------------------- 02-Mar-2025 12:58:05.157 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"] 02-Mar-2025 12:58:05.165 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [4994] milliseconds

[Tuncay Senturk _Snapbytes_]

Hi @Stephen 

Your log file indicates that "jira.clusternode" does not exist, which means the required table is either missing or not granted to the user that Jira uses to connect to your database. Check if the table exists; if it does not, the database is incomplete or empty.

You can also check the dbconfig.xml file to double-check the hostname and database credentials, ensuring it is not inadvertently pointing to the wrong database.

[Stephen]

Thanks, it was an issue where someone attempted to redeploy using a jira instead of public schema which overwrote the original public schema. We were able to redeploy and restore using the original schema name.