Database: JIRA couldn't connect to your database - after jira and postgresql upgrade

[D Mitchell]

I searched and the similar threads didn't help.   So I turning to you kind folks.

I just upgraded jira from 8.13.10 to 8.20.1 (because of security vulnerabilities).

With that I had to upgrade from PostgreSQL 9.6 to 10.

But when I restart everything, I get "Database: JIRA couldn't connect to your database" on the jira splash page.   

I tried granting privs and setting a password found in:  https://community.atlassian.com/t5/Jira-questions/Which-PostgreSQL-username-and-password-should-be-used-to-setup/qaq-p/732682

GRANT ALL PRIVILEGES ON DATABASE jiradb TO jiradbuser;

ALTER USER jiradbuser with PASSWORD 'jiradbuser'

Any ideas what I did wrong this upgrade?  I've upgraded both before without issue.   I must be missing something. 

Config and logs below:

My dbconfig.xml:

cat /data/atlassian/application-data/jira/dbconfig.xml
<?xml version="1.0" encoding="UTF-8"?>

<jira-database-config>
<name>defaultDS</name>
<delegator-name>default</delegator-name>
<database-type>postgres72</database-type>
<schema-name>public</schema-name>
<jdbc-datasource>
<url>jdbc:postgresql://localhost:5432/jiradb</url>
<driver-class>org.postgresql.Driver</driver-class>
<username>jiradbuser</username>
<password>XXXX</password>
<pool-min-size>20</pool-min-size>
<pool-max-size>20</pool-max-size>
<pool-max-wait>30000</pool-max-wait>
<validation-query>select version();</validation-query>
<min-evictable-idle-time-millis>60000</min-evictable-idle-time-millis>
<time-between-eviction-runs-millis>300000</time-between-eviction-runs-millis>
<pool-max-idle>20</pool-max-idle>
<pool-remove-abandoned>true</pool-remove-abandoned>
<pool-remove-abandoned-timeout>300</pool-remove-abandoned-timeout>
<pool-test-on-borrow>false</pool-test-on-borrow>
<pool-test-while-idle>true</pool-test-while-idle>
<connection-properties>tcpKeepAlive=true;socketTimeout=240</connection-properties>
</jdbc-datasource>
</jira-database-config>

catalina.out:

2021-11-16 15:13:38,977+0000 JIRA-Bootstrap INFO [c.a.jira.startup.JiraStartupLogger]

****************
Jira starting...
****************

2021-11-16 15:13:39,134+0000 JIRA-Bootstrap INFO [c.a.jira.startup.JiraStartupLogger]

___ Environment _____________________________

JIRA Build : 8.20.1#820001-sha1:6d4b94dbcc29d26a5651b231dd69e39cd4357315
Build Date : Thu Oct 28 00:00:00 GMT 2021
JIRA Installation Type : Standalone
Application Server : Apache Tomcat/8.5.65 - Servlet API 3.1
Java Version : 11.0.11 - AdoptOpenJDK
Current Working Directory : /opt/atlassian/jira/bin
Maximum Allowable Memory : 2048MB
Total Memory : 1024MB
Free Memory : 389MB
Used Memory : 635MB
Memory Pool: CodeHeap 'non-nmethods' : CodeHeap 'non-nmethods': init = 5832704(5696K) used = 1162752(1135K) committed = 5832704(5696K) max = 5832704(5696K)
Memory Pool: Metaspace : Metaspace: init = 0(0K) used = 29026096(28345K) committed = 29933568(29232K) max = -1(-1K)
Memory Pool: CodeHeap 'profiled nmethods' : CodeHeap 'profiled nmethods': init = 33554432(32768K) used = 9379968(9160K) committed = 33554432(32768K) max = 265519104(259296K)
Memory Pool: Compressed Class Space : Compressed Class Space: init = 0(0K) used = 3149296(3075K) committed = 3538944(3456K) max = 1073741824(1048576K)
Memory Pool: G1 Eden Space : G1 Eden Space: init = 56623104(55296K) used = 3145728(3072K) committed = 657457152(642048K) max = -1(-1K)
Memory Pool: G1 Old Gen : G1 Old Gen: init = 1017118720(993280K) used = 21203488(20706K) committed = 397410304(388096K) max = 2147483648(2097152K)
Memory Pool: G1 Survivor Space : G1 Survivor Space: init = 0(0K) used = 18874368(18432K) committed = 18874368(18432K) max = -1(-1K)
Memory Pool: CodeHeap 'non-profiled nmethods' : CodeHeap 'non-profiled nmethods': init = 33554432(32768K) used = 2918656(2850K) committed = 33554432(32768K) max = 265519104(259296K)
JVM Input Arguments : --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED -Djava.util.logging.config.file=/opt/atlassian/jira/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Xms1024m -Xmx2048m -XX:InitialCodeCacheSize=32m -XX:ReservedCodeCacheSize=512m -Djava.awt.headless=true -Datlassian.standalone=JIRA -Dorg.apache.jasper.runtime.BodyContentImpl.LIMIT_BUFFER=true -Dmail.mime.decodeparameters=true -Dorg.dom4j.factory=com.atlassian.core.xml.InterningDocumentFactory -XX:-OmitStackTraceInFastThrow -Djava.locale.providers=COMPAT -Datlassian.plugins.startup.options= -Djdk.tls.ephemeralDHKeySize=2048 -Djava.protocol.handler.pkgs=org.apache.catalina.webresources -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 -Xlog:gc*:file=/opt/atlassian/jira/logs/atlassian-jira-gc-%t.log:tags,time,uptime,level:filecount=5,filesize=20M -XX:+ExplicitGCInvokesConcurrent -Dignore.endorsed.dirs= -Dcatalina.base=/opt/atlassian/jira -Dcatalina.home=/opt/atlassian/jira -Djava.io.tmpdir=/opt/atlassian/jira/temp
Java Compatibility Information : JIRA version = 8.20.1, Java Version = 11.0.11

___ Java System Properties _________________

atlassian.plugins.startup.options :
atlassian.standalone : JIRA
awt.toolkit : sun.awt.X11.XToolkit
catalina.base : /opt/atlassian/jira
catalina.home : /opt/atlassian/jira
catalina.useNaming : true
common.loader : "${catalina.base}/lib",
"${catalina.base}/lib/*.jar",
"${catalina.home}/lib",
"${catalina.home}/lib/*.jar"
file.encoding : UTF-8
ignore.endorsed.dirs :
java.awt.graphicsenv : sun.awt.X11GraphicsEnvironment
java.awt.headless : true
java.awt.printerjob : sun.print.PSPrinterJob
java.class.version : 55.0
java.home : /opt/atlassian/jira/jre
java.io.tmpdir : /opt/atlassian/jira/temp
java.locale.providers : COMPAT
java.naming.factory.initial : org.apache.naming.java.javaURLContextFactory
java.naming.factory.url.pkgs : org.apache.naming
java.protocol.handler.pkgs : org.apache.catalina.webresources
java.runtime.name : OpenJDK Runtime Environment
java.runtime.version : 11.0.11+9
java.specification.name : Java Platform API Specification
java.specification.vendor : Oracle Corporation
java.specification.version : 11
java.util.logging.config.file : /opt/atlassian/jira/conf/logging.properties
java.util.logging.manager : org.apache.juli.ClassLoaderLogManager
java.vendor : AdoptOpenJDK
java.vendor.url : https://adoptopenjdk.net/
java.vendor.url.bug : https://github.com/AdoptOpenJDK/openjdk-support/issues
java.vendor.version : AdoptOpenJDK-11.0.11+9
java.version : 11.0.11
java.version.date : 2021-04-20
java.vm.compressedOopsMode : 32-bit
java.vm.info : mixed mode
java.vm.name : OpenJDK 64-Bit Server VM
java.vm.specification.name : Java Virtual Machine Specification
java.vm.specification.vendor : Oracle Corporation
java.vm.specification.version : 11
java.vm.vendor : AdoptOpenJDK
java.vm.version : 11.0.11+9
jdk.debug : release
jdk.tls.ephemeralDHKeySize : 2048
mail.mime.decodeparameters : true
org.apache.catalina.security.SecurityListener.UMASK : 0027
org.apache.jasper.runtime.BodyContentImpl.LIMIT_BUFFER : true
org.dom4j.factory : com.atlassian.core.xml.InterningDocumentFactory
os.arch : amd64
os.name : Linux
os.version : 2.6.32-754.35.1.el6.x86_64
package.access : sun.,
org.apache.catalina.,
org.apache.coyote.,
org.apache.jasper.,
org.apache.tomcat.
package.definition : sun.,
java.,
org.apache.catalina.,
org.apache.coyote.,
org.apache.jasper.,
org.apache.naming.,
org.apache.tomcat.
server.loader :
shared.loader :
sun.arch.data.model : 64
sun.boot.library.path : /opt/atlassian/jira/jre/lib
sun.cpu.endian : little
sun.cpu.isalist :
sun.io.unicode.encoding : UnicodeLittle
sun.java.command : org.apache.catalina.startup.Bootstrap start
sun.java.launcher : SUN_STANDARD
sun.jnu.encoding : UTF-8
sun.management.compiler : HotSpot 64-Bit Tiered Compilers
sun.os.patch.level : unknown
tomcat.util.buf.StringCache.byte.enabled : true
tomcat.util.scan.StandardJarScanFilter.jarsToScan : log4j-taglib*.jar,
log4j-web*.jar,
log4javascript*.jar,
slf4j-taglib*.jar
tomcat.util.scan.StandardJarScanFilter.jarsToSkip : annotations-api.jar,
ant-junit*.jar,
ant-launcher.jar,
ant.jar,
asm-*.jar,
aspectj*.jar,
bootstrap.jar,
catalina-ant.jar,
catalina-ha.jar,
catalina-jmx-remote.jar,
catalina-storeconfig.jar,
catalina-tribes.jar,
catalina-ws.jar,
catalina.jar,
cglib-*.jar,
cobertura-*.jar,
commons-beanutils*.jar,
commons-codec*.jar,
commons-collections*.jar,
commons-daemon.jar,
commons-dbcp*.jar,
commons-digester*.jar,
commons-fileupload*.jar,
commons-httpclient*.jar,
commons-io*.jar,
commons-lang*.jar,
commons-logging*.jar,
commons-math*.jar,
commons-pool*.jar,
dom4j-*.jar,
easymock-*.jar,
ecj-*.jar,
el-api.jar,
geronimo-spec-jaxrpc*.jar,
h2*.jar,
hamcrest-*.jar,
hibernate*.jar,
httpclient*.jar,
icu4j-*.jar,
jasper-el.jar,
jasper.jar,
jaspic-api.jar,
jaxb-*.jar,
jaxen-*.jar,
jdom-*.jar,
jetty-*.jar,
jmx-tools.jar,
jmx.jar,
jsp-api.jar,
jstl.jar,
jta*.jar,
junit-*.jar,
junit.jar,
log4j*.jar,
mail*.jar,
objenesis-*.jar,
oraclepki.jar,
oro-*.jar,
servlet-api-*.jar,
servlet-api.jar,
slf4j*.jar,
taglibs-standard-spec-*.jar,
tagsoup-*.jar,
tomcat-api.jar,
tomcat-coyote.jar,
tomcat-dbcp.jar,
tomcat-i18n-*.jar,
tomcat-jdbc.jar,
tomcat-jni.jar,
tomcat-juli-adapters.jar,
tomcat-juli.jar,
tomcat-util-scan.jar,
tomcat-util.jar,
tomcat-websocket.jar,
tools.jar,
websocket-api.jar,
wsdl4j*.jar,
xercesImpl.jar,
xml-apis.jar,
xmlParserAPIs-*.jar,
xmlParserAPIs.jar,
xom-*.jar
user.country : US
user.dir : /opt/atlassian/jira/bin
user.home : /home/jira1
user.language : en
user.name : jira1
user.timezone : GMT

16-Nov-2021 15:13:39.241 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8082"]
16-Nov-2021 15:13:39.250 INFO [main] org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a shared selector for servlet write/read
16-Nov-2021 15:13:39.288 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 5624 ms
2021-11-16 15:13:39,460+0000 JIRA-Bootstrap INFO [c.a.j.config.database.SystemDatabaseConfigurationLoader] Reading database configuration from /data/atlassian/application-data/jira/dbconfig.xml
2021-11-16 15:13:39,518+0000 JIRA-Bootstrap INFO [c.a.j.config.database.DatabaseConfigHandler] Trying to get encrypted password from xml and decrypt it
2021-11-16 15:13:39,520+0000 JIRA-Bootstrap INFO [c.a.j.config.database.DatabaseConfigHandler] Database password decryption not performed.
2021-11-16 15:13:39,937+0000 JIRA-Bootstrap INFO [c.a.jira.startup.JiraStartupLogger] Running Jira startup checks.
2021-11-16 15:13:39,938+0000 JIRA-Bootstrap FATAL [c.a.jira.startup.JiraStartupLogger] Startup check failed. Jira will be locked.
2021-11-16 15:13:40,005+0000 JIRA-Bootstrap INFO [c.a.jira.startup.LauncherContextListener] Startup is complete. Jira is ready to serve.
2021-11-16 15:13:40,007+0000 JIRA-Bootstrap INFO [c.a.jira.startup.LauncherContextListener] Memory Usage:
---------------------------------------------------------------------------------
Heap memory : Used: 183 MiB. Committed: 1024 MiB. Max: 2048 MiB
Non-heap memory : Used: 52 MiB. Committed: 109 MiB. Max: 1536 MiB
---------------------------------------------------------------------------------
TOTAL : Used: 235 MiB. Committed: 1133 MiB. Max: 3584 MiB
---------------------------------------------------------------------------------

But what I don't see is the Database Configuration bit like before.  This IS FROM AN OLDER LOG:

___ Database Configuration _________________

Loading entityengine.xml from : file:/opt/atlassian/jira/atlassian-jira/WEB-INF/classes/entityengine.xml
Entity model field type name : postgres72
Entity model schema name : public
Database Version : PostgreSQL - 9.6.19
Database Driver : PostgreSQL JDBC Driver - 42.2.23
Database URL : jdbc:postgresql://localhost:5432/jiradb
Database JDBC config : postgres72 jdbc:postgresql://localhost:5432/jiradb

2021-11-11 20:26:16,839+0000 JIRA-Bootstrap INFO [c.a.jira.startup.JiraStartupLogger]

[D Mitchell]

oh man, I diff'd my pg_hba.conf's from 9.6 -> 10 and setting this to 'trust' from ident makes is all work

host all all 127.0.0.1/32 trust

Thanks

[Thomas Deiler]

Dear @D Mitchell ,

have you tried to 

telnet localhost 5432

Is there a connect?

If not, have a look at my article (Part 1). With the PostgreSQL upgrade, the config files got most probably overwritten.

So long

Thomas

[D Mitchell]

@Thomas DeilerI just did.  It is listening:

telnet localhost 5432
Trying ::1...
Connected to localhost.
Escape character is '^]'.