Unable to start jira

[manoj reddy]

aseUtil] Created function based indices for entity "NotificationScheme"
2019-09-03 12:29:29,722 localhost-startStop-1 INFO [o.o.c.entity.jdbc.Datab aseUtil] Created function based indices for entity "Group"
2019-09-03 12:29:29,722 localhost-startStop-1 INFO [o.o.c.entity.jdbc.Datab aseUtil] Created function based indices for entity "IssueSecurityScheme"
2019-09-03 12:29:29,724 localhost-startStop-1 INFO [c.a.j.config.database.D atabaseConfigurationManagerImpl] The database is configured. Now running Databas e Checklist Launcher
2019-09-03 12:29:29,730 localhost-startStop-1 INFO [c.a.jira.startup.Databa seChecklistLauncher] JIRA database startup checks completed successfully.
2019-09-03 12:29:29,731 localhost-startStop-1 INFO [c.a.j.config.database.D atabaseConfigurationManagerImpl] The database is configured. Now running Post da tabase-configuration launchers
2019-09-03 12:29:32,319 localhost-startStop-1 INFO [c.a.jira.cluster.Replic atorExecutorServiceFactory] EhCache replication thread pool initialization
2019-09-03 12:29:33,174 localhost-startStop-1 INFO [c.a.j.cluster.distribut ion.JiraRMICacheManagerPeerProviderFactory] Starting Jira instance with default cache replication strategy
2019-09-03 12:29:33,336 localhost-startStop-1 INFO [c.a.j.c.cache.ehcache.R eplicatorFactory] [Cache-replication] Cache replication using default cache repl icator: LocalQCacheReplicator
2019-09-03 12:29:33,341 localhost-startStop-1 INFO [c.a.j.c.cache.ehcache.R eplicatorFactory] [Cache-replication] Cache replication using default cache repl icator: LocalQCacheReplicator
2019-09-03 12:29:33,343 localhost-startStop-1 INFO [c.a.j.c.cache.ehcache.R eplicatorFactory] [Cache-replication] Cache replication using default cache repl icator: LocalQCacheReplicator
2019-09-03 12:29:33,345 localhost-startStop-1 INFO [c.a.j.c.cache.ehcache.R eplicatorFactory] [Cache-replication] Cache replication using default cache repl icator: LocalQCacheReplicator
2019-09-03 12:29:33,440 localhost-startStop-1 INFO [c.a.j.config.database.S ystemDatabaseConfigurationLoader] Reading database configuration from /var/atlas sian/application-data/jira/dbconfig.xml
2019-09-03 12:29:34,547 localhost-startStop-1 ERROR [c.a.jira.startup.Compo nentContainerLauncher] A fatal error occurred during initialisation. JIRA has be en locked.
net.sf.ehcache.CacheException: Problem starting listener for RMICachePeer //10.1 20.3.116:40001/com.atlassian.jira.task.TaskManagerImpl.taskMap. Initial cause wa s Connection refused to host: 10.120.3.116; nested exception is:
java.net.ConnectException: Connection refused (Connection refused)
at net.sf.ehcache.distribution.RMICacheManagerPeerListener.notifyCacheAd ded(RMICacheManagerPeerListener.java:539)
at net.sf.ehcache.event.CacheManagerEventListenerRegistry.notifyCacheAdd ed(CacheManagerEventListenerRegistry.java:159)
at net.sf.ehcache.CacheManager.addCacheNoCheck(CacheManager.java:1448)
at net.sf.ehcache.CacheManager.addConfiguredCaches(CacheManager.java:832 )
at net.sf.ehcache.CacheManager.doInit(CacheManager.java:500)
at net.sf.ehcache.CacheManager.init(CacheManager.java:395)
at net.sf.ehcache.CacheManager.<init>(CacheManager.java:270)
at net.sf.ehcache.CacheManager.newInstance(CacheManager.java:1116)
at net.sf.ehcache.CacheManager.newInstance(CacheManager.java:1092)
at com.atlassian.jira.component.pico.registrar.CacheManagerRegistrar.get CacheManagerDelegate(CacheManagerRegistrar.java:259)
at com.atlassian.jira.component.pico.registrar.CacheManagerRegistrar.reg isterCacheManager(CacheManagerRegistrar.java:159)
at com.atlassian.jira.component.pico.registrar.ContainerRegistrar.regist erCacheManager(ContainerRegistrar.java:3868)
at com.atlassian.jira.component.pico.registrar.ContainerRegistrar.regist erComponents(ContainerRegistrar.java:3829)
at com.atlassian.jira.component.pico.ComponentManager.registerComponents (ComponentManager.java:454)
at com.atlassian.jira.component.pico.ComponentManager.initialise(Compone ntManager.java:171)
at com.atlassian.jira.startup.ComponentContainerLauncher.populateFullPic oContainer(ComponentContainerLauncher.java:50)
at com.atlassian.jira.startup.ComponentContainerLauncher.start(Component ContainerLauncher.java:30)
at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$postDbLaunch$2( DefaultJiraLauncher.java:138)
at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.d oNowOrEnqueue(DatabaseConfigurationManagerImpl.java:304)
at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.d oNowOrWhenDatabaseActivated(DatabaseConfigurationManagerImpl.java:199)
at com.atlassian.jira.startup.DefaultJiraLauncher.postDbLaunch(DefaultJi raLauncher.java:135)
at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$start$0(Default JiraLauncher.java:102)
at com.atlassian.jira.util.devspeed.JiraDevSpeedTimer.run(JiraDevSpeedTi mer.java:31)
at com.atlassian.jira.startup.DefaultJiraLauncher.start(DefaultJiraLaunc her.java:100)
at com.atlassian.jira.startup.LauncherContextListener.initSlowStuff(Laun cherContextListener.java:154)
at com.atlassian.jira.startup.LauncherContextListener.initSlowStuffInBac kground(LauncherContextListener.java:139)
at com.atlassian.jira.startup.LauncherContextListener.contextInitialized (LauncherContextListener.java:101)
... 5 filtered
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.rmi.ConnectException: Connection refused to host: 10.120.3.116; nested exception is:
java.net.ConnectException: Connection refused (Connection refused)
at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216 )
at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:338)
at java.rmi.Naming.rebind(Naming.java:177)
at net.sf.ehcache.distribution.RMICacheManagerPeerListener.bind(RMICache ManagerPeerListener.java:234)
at net.sf.ehcache.distribution.RMICacheManagerPeerListener.notifyCacheAd ded(RMICacheManagerPeerListener.java:536)
... 35 more
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.ja va:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocket Impl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java :188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:538)
at java.net.Socket.<init>(Socket.java:434)
at java.net.Socket.<init>(Socket.java:211)
at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirect SocketFactory.java:40)
at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMaster SocketFactory.java:148)
at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
... 42 more
2019-09-03 12:29:34,591 localhost-startStop-1 ERROR [c.a.jira.health.Health Checks] We couldn't start JIRA
2019-09-03 12:29:34,591 localhost-startStop-1 ERROR [c.a.jira.health.Health Checks] An error occurred while trying to start JIRA. We can't give you any more detail right now, we suggest checking the logs for more detail and contacting o ur support team.
See our documentation for more information on contacting our support team an d creating a support zip.
2019-09-03 12:29:34,591 localhost-startStop-1 INFO [c.a.jira.startup.Databa seLauncher] Database transactions enabled: true
2019-09-03 12:29:34,592 localhost-startStop-1 INFO [c.a.jira.startup.Databa seLauncher] Using JIRA's default for database transaction isolation level: 2
2019-09-03 12:29:34,603 localhost-startStop-1 INFO [c.a.jira.startup.JiraSt artupLogger]

Database configuration OK

___ Database Configuration _________________

Loading entityengine.xml from : file:/opt/atlassian/jir a/atlassian-jira/WEB-INF/classes/entityengine.xml
Entity model field type name : postgres72
Entity model schema name : public
Database Version : PostgreSQL - 9.5.15
Database Driver : PostgreSQL Native Drive r - PostgreSQL 9.4.1212
Database URL : jdbc:postgresql://sd1ic utf3jea5zp.czit2o9aq8rn.us-east-1.rds.amazonaws.com:5432/jira?ssl=true
Database JDBC config : postgres72 jdbc:postgre sql://sd1icutf3jea5zp.czit2o9aq8rn.us-east-1.rds.amazonaws.com:5432/jira?ssl=tru e

2019-09-03 12:29:34,605 localhost-startStop-1 ERROR [c.a.jira.startup.Launc herContextListener] Unable to start JIRA.
java.lang.NullPointerException
at com.atlassian.jira.startup.DefaultJiraLauncher.recordStartupMode(Defa ultJiraLauncher.java:153)
at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$postDbLaunch$2( DefaultJiraLauncher.java:140)
at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.d oNowOrEnqueue(DatabaseConfigurationManagerImpl.java:304)
at com.atlassian.jira.config.database.DatabaseConfigurationManagerImpl.d oNowOrWhenDatabaseActivated(DatabaseConfigurationManagerImpl.java:199)
at com.atlassian.jira.startup.DefaultJiraLauncher.postDbLaunch(DefaultJi raLauncher.java:135)
at com.atlassian.jira.startup.DefaultJiraLauncher.lambda$start$0(Default JiraLauncher.java:102)
at com.atlassian.jira.util.devspeed.JiraDevSpeedTimer.run(JiraDevSpeedTi mer.java:31)
at com.atlassian.jira.startup.DefaultJiraLauncher.start(DefaultJiraLaunc her.java:100)
at com.atlassian.jira.startup.LauncherContextListener.initSlowStuff(Laun cherContextListener.java:154)
at com.atlassian.jira.startup.LauncherContextListener.initSlowStuffInBac kground(LauncherContextListener.java:139)
at com.atlassian.jira.startup.LauncherContextListener.contextInitialized (LauncherContextListener.java:101)
... 5 filtered
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:624)
at java.lang.Thread.run(Thread.java:748)
2019-09-03 12:29:34,609 localhost-startStop-1 INFO [c.a.jira.startup.Launch erContextListener] Memory Usage:
---------------------------------------------------------------------------- -----
Heap memory : Used: 567 MiB. Committed: 11776 MiB. Max: 11776 MiB
Non-heap memory : Used: 65 MiB. Committed: 82 MiB. Max: 1536 MiB
---------------------------------------------------------------------------- -----
TOTAL : Used: 632 MiB. Committed: 11858 MiB. Max: 13312 MiB
---------------------------------------------------------------------------- -----
03-Sep-2019 12:29:34.966 INFO [main] org.apache.coyote.AbstractProtocol.start St arting ProtocolHandler ["http-nio-8080"]
03-Sep-2019 12:29:34.972 INFO [main] org.apache.tomcat.util.net.NioSelectorPool. getSharedSelector Using a shared selector for servlet write/read
03-Sep-2019 12:29:35.003 INFO [main] org.apache.coyote.AbstractProtocol.start St arting ProtocolHandler ["http-nio-8081"]
03-Sep-2019 12:29:35.003 INFO [main] org.apache.tomcat.util.net.NioSelectorPool. getSharedSelector Using a shared selector for servlet write/read
03-Sep-2019 12:29:35.024 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 51386 ms
2019-09-03 12:29:45,649 http-nio-8080-exec-1 ERROR anonymous 749x1x1 - 10.120.3. 233 /status [c.atlassian.instrumentation.Instrument] Unable to snapshot thread l ocal operations (implementation of OpTimerFactory is not a ThreadLocalOpTimerFac tory): null
2019-09-03 12:29:45,704 http-nio-8080-exec-1 WARN anonymous 749x1x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:29:50,801 http-nio-8080-exec-2 WARN anonymous 749x2x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:15,457 http-nio-8080-exec-4 WARN anonymous 750x3x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:20,832 http-nio-8080-exec-3 WARN anonymous 750x4x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:45,456 http-nio-8080-exec-5 WARN anonymous 750x5x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:50,843 http-nio-8080-exec-6 WARN anonymous 750x6x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:15,461 http-nio-8080-exec-8 WARN anonymous 751x7x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:20,875 http-nio-8080-exec-7 WARN anonymous 751x8x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:45,488 http-nio-8080-exec-9 WARN anonymous 751x9x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:50,902 http-nio-8080-exec-10 WARN anonymous 751x10x1 - 10.120.2 .212 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive request that bypassed Johnson filter: /status
^C
[jira@owzhodyyymy4mwf bin]$ tail -f /var/atlassian/application-data/jira/log/atl assian-jira.log
2019-09-03 12:29:50,801 http-nio-8080-exec-2 WARN anonymous 749x2x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:15,457 http-nio-8080-exec-4 WARN anonymous 750x3x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:20,832 http-nio-8080-exec-3 WARN anonymous 750x4x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:45,456 http-nio-8080-exec-5 WARN anonymous 750x5x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:30:50,843 http-nio-8080-exec-6 WARN anonymous 750x6x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:15,461 http-nio-8080-exec-8 WARN anonymous 751x7x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:20,875 http-nio-8080-exec-7 WARN anonymous 751x8x1 - 10.120.2.2 12 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:45,488 http-nio-8080-exec-9 WARN anonymous 751x9x1 - 10.120.3.2 33 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive r equest that bypassed Johnson filter: /status
2019-09-03 12:31:50,902 http-nio-8080-exec-10 WARN anonymous 751x10x1 - 10.120.2 .212 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive request that bypassed Johnson filter: /status
2019-09-03 12:32:15,517 http-nio-8080-exec-1 WARN anonymous 752x11x1 - 10.120.3. 233 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive request that bypassed Johnson filter: /status
2019-09-03 12:32:20,931 http-nio-8080-exec-2 WARN anonymous 752x12x1 - 10.120.2. 212 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive request that bypassed Johnson filter: /status
2019-09-03 12:32:45,539 http-nio-8080-exec-4 WARN anonymous 752x13x1 - 10.120.3. 233 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive request that bypassed Johnson filter: /status
2019-09-03 12:32:50,961 http-nio-8080-exec-3 WARN anonymous 752x14x1 - 10.120.2. 212 /status [c.a.jira.security.JiraSecurityFilter] Rejecting security-sensitive request that bypassed Johnson filter: /status

[manoj reddy g]

Final answer. 

Edit cluster.properties file in /var/Atlassian/application-data/jira and give the current node IP address.That's it

[Pete Singleton]

It might be a problem connecting to the Jira database.  Where is your instance hosted?  There is a message Connection refused to host: 10.120.3.116.  Do you know what that host is?

[manoj reddy g]

Hello 

DB is hosted in AWS.10.120.3.116 is IP of other Jira instance node.

[Pete Singleton]

Is the other Jira node running?  Are you able to check the DB is available?

[manoj reddy g]

Yes, the other node is working fine.I have copied the same to the current node