Tomcat periodically encounters Java heap space OOM error

[정윤미]

Problem : 

Tomcat periodically encounters Java heap space OOM error and the Confluence web page is down.

Error Log :

java.lang.OutOfMemoryError: Java heap space
java.lang.IllegalStateException: Fatal Exception thrown on Scheduler.Worker thread.
at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:62)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
Exception in thread "AsyncFileHandlerWriter-1259475182" java.lang.OutOfMemoryError: Java heap space
Exception in thread "C3P0PooledConnectionPoolManager[identityToken->z8kfltaa19zvp6e1xi04fp|796573de]-AdminTaskTimer" java.lang.OutOfMemoryError: Java heap space
Exception in thread "I/O dispatcher 3" java.lang.OutOfMemoryError: Java heap space

We did : 

Location: /opt/atlassian/wiki/bin

File name: setenv.sh

2.1 Changed from Xmx1024m to Xmx2048m
CATALINA_OPTS="-Xms1024m -Xmx2048m -XX:+UseG1GC ${CATALINA_OPTS}"

2.2 Option to create dump when OOM occurs later
export CATALINA_OPTS=" ${CATALINA_OPTS} -XX:+HeapDumpOnOutOfMemoryError"
export CATALINA_OPTS=" ${CATALINA_OPTS} -XX:HeapDumpPath=/test2/was/apache-tomcat-9.0.12/logs/hdump"

Result :

The server started well, so the wiki page was well connected.

But When editing and copying pages, etc., it becomes infinitely loaded, and an error occurred that could not be retrieved.

Please let us know how we should solve this problem.

[Nic Brough -Adaptavist-]

This is often what it says - the heap is too small for something in your Confluence and you need to give it more memory.

However, there's also a db error in there, and sometimes those can cause loops which then cause memory leaks, leading to the heap space error.

What are the database settings in confluence.cfg.xml in the home directory?  Do NOT give us all of the file, it's got private stuff in it.  We only need to see the lines starting with <property name="hibernate. and please remove the username and password lines completely as well.

[정윤미]

Sorry for the delay.

This is the our confluence.cfg.xml

===============================================

<?xml version="1.0" encoding="UTF-8"?>

<confluence-configuration>
<setupStep>complete</setupStep>
<setupType>custom</setupType>
<buildNumber>8100</buildNumber>
<properties>
<property name="admin.ui.allow.daily.backup.custom.location">false</property>
<property name="admin.ui.allow.manual.backup.download">false</property>
<property name="admin.ui.allow.site.support.email">false</property>
<property name="atlassian.license.message"></property>
<property name="attachments.dir">${confluenceHome}/attachments</property>
<property name="confluence.setup.locale">ko_KR</property>
<property name="confluence.setup.server.id">BSPL-SWJW-LNNS-DUK2</property>
<property name="confluence.webapp.context.path"></property>
<property name="hibernate.c3p0.acquire_increment">1</property>
<property name="hibernate.c3p0.idle_test_period">100</property>
<property name="hibernate.c3p0.max_size">60</property>
<property name="hibernate.c3p0.max_statements">0</property>
<property name="hibernate.c3p0.min_size">20</property>
<property name="hibernate.c3p0.preferredTestQuery">select 1</property>
<property name="hibernate.c3p0.timeout">30</property>
<property name="hibernate.connection.driver_class">com.mysql.jdbc.Driver</property>
<property name="hibernate.connection.isolation">2</property>
<property name="hibernate.connection.password"></property>
<property name="hibernate.connection.url">jdbc:mysql://localhost:3306/wiki</property>
<property name="hibernate.connection.username"></property>
<property name="hibernate.database.lower_non_ascii_supported">true</property>
<property name="hibernate.dialect">com.atlassian.confluence.impl.hibernate.dialect.MySQLDialect</property>
<property name="hibernate.setup">true</property>
<property name="jwt.private.key">
<property name="jwt.public.key"></property>
<property name="lucene.index.dir">${localHome}/index</property>
<property name="setup.hasSelectedBundle">true</property>
<property name="synchrony.encryption.disabled">true</property>
<property name="synchrony.proxy.enabled">true</property>
<property name="webwork.multipart.saveDir">${localHome}/temp</property>
</properties>
</confluence-configuration>

[정윤미]

hi

Could you check our xml file?

===============================================

<?xml version="1.0" encoding="UTF-8"?>

<confluence-configuration>
<setupStep>complete</setupStep>
<setupType>custom</setupType>
<buildNumber>8100</buildNumber>
<properties>
<property name="admin.ui.allow.daily.backup.custom.location">false</property>
<property name="admin.ui.allow.manual.backup.download">false</property>
<property name="admin.ui.allow.site.support.email">false</property>
<property name="atlassian.license.message"></property>
<property name="attachments.dir">${confluenceHome}/attachments</property>
<property name="confluence.setup.locale">ko_KR</property>
<property name="confluence.setup.server.id">BSPL-SWJW-LNNS-DUK2</property>
<property name="confluence.webapp.context.path"></property>
<property name="hibernate.c3p0.acquire_increment">1</property>
<property name="hibernate.c3p0.idle_test_period">100</property>
<property name="hibernate.c3p0.max_size">60</property>
<property name="hibernate.c3p0.max_statements">0</property>
<property name="hibernate.c3p0.min_size">20</property>
<property name="hibernate.c3p0.preferredTestQuery">select 1</property>
<property name="hibernate.c3p0.timeout">30</property>
<property name="hibernate.connection.driver_class">com.mysql.jdbc.Driver</property>
<property name="hibernate.connection.isolation">2</property>
<property name="hibernate.connection.password"></property>
<property name="hibernate.connection.url">jdbc:mysql://localhost:3306/wiki</property>
<property name="hibernate.connection.username"></property>
<property name="hibernate.database.lower_non_ascii_supported">true</property>
<property name="hibernate.dialect">com.atlassian.confluence.impl.hibernate.dialect.MySQLDialect</property>
<property name="hibernate.setup">true</property>
<property name="jwt.private.key">
<property name="jwt.public.key"></property>
<property name="lucene.index.dir">${localHome}/index</property>
<property name="setup.hasSelectedBundle">true</property>
<property name="synchrony.encryption.disabled">true</property>
<property name="synchrony.proxy.enabled">true</property>
<property name="webwork.multipart.saveDir">${localHome}/temp</property>
</properties>
</confluence-configuration>

[Nic Brough -Adaptavist-]

Ok, that looks fine.

You'll need to give the Tomcat more memory to work with.  Increase the heap by amending the -Xmx setting in the setenv.sh file in <confluence install>/bin

[정윤미]

Hi 

I tried applying -Xmx after raising the value in setenv.
The wiki page is normally accessed, but the infinite loading takes place in the article-editing section of the wiki site, and the following log is repeated in the tomcat log, so the tomcat is not normally started.

Error message is "There was a problem after loading the editor. Copy any unsaved changes, refresh the page and continue editing."

Tomcat log :

[http-nio-8090-exec-4] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
[http-nio-8090-exec-4] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.sun.jersey.server.wadl.generators.WadlGeneratorApplicationDoc
[http-nio-8090-exec-4] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.grammars.WadlGrammarsAdaptor
[http-nio-8090-exec-4] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.resourcedoc.AtlassianWadlGeneratorResourceDocSupport
[http-nio-8090-exec-9] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
[http-nio-8090-exec-6] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM

[http-nio-8090-exec-6] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.sun.jersey.server.wadl.generators.WadlGeneratorApplicationDoc
[http-nio-8090-exec-6] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.grammars.WadlGrammarsAdaptor
[http-nio-8090-exec-6] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.resourcedoc.AtlassianWadlGeneratorResourceDocSupport
[http-nio-8090-exec-8] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'
[http-nio-8090-exec-13] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.4 05/24/2017 03:20 PM'

[Nic Brough -Adaptavist-]

Could you give us the errors in the application log too?

[정윤미]

What's the application log?

We only have tomcat log and when we restarted the server, the server comes up normally. 

But when we modify the page, there was an error. 

Error message translation:

There was a problem after loading the editor. Copy any unsaved changes, refresh the page and continue editing.

[Nic Brough -Adaptavist-]

The application log is in <confluence data>/logs/ - look for atlassian-confluence.log, but have a read of all the others in there

[yunyoung]

Hi,

she is busy.

I send instead of her.

<atlassian-confluence.log>

2020-07-09 08:54:50,155 INFO [Gemini Blueprint context shutdown thread 1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] lambda$stop$9 Stopping Synchrony...
2020-07-09 08:54:53,161 INFO [Gemini Blueprint context shutdown thread 1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] lambda$stop$9 Stopping Synchrony...
2020-07-09 08:54:54,092 WARN [Gemini Blueprint context shutdown thread 1] [expose.jmx.schedule.JmxInstrumentSchedulerImpl] destroy atlassian-instrumentation-jmx expose scheduler stopped.
2020-07-09 08:54:55,076 WARN [alert-dispatch:thread-1] [atlassian.diagnostics.internal.LockFreeAlertPublisher] run AlertListener com.atlassian.diagnostics.internal.LoggingAlertListener failed
com.atlassian.confluence.impl.osgi.OsgiNoServiceAvailableException: No service available for com.atlassian.sal.api.message.I18nResolver
at com.atlassian.confluence.impl.osgi.OsgiServiceRegistryImpl$ServiceTrackingProxy.invoke(OsgiServiceRegistryImpl.java:89)
at com.sun.proxy.$Proxy164.getText(Unknown Source)
at com.atlassian.diagnostics.internal.SimpleIssue.getSummary(SimpleIssue.java:71)
at com.atlassian.diagnostics.internal.LoggingAlertListener.createDataLoggerMessage(LoggingAlertListener.java:98)
at com.atlassian.diagnostics.internal.LoggingAlertListener.onAlert(LoggingAlertListener.java:62)
at com.atlassian.diagnostics.internal.LockFreeAlertPublisher$AlertListenerInvoker.run(LockFreeAlertPublisher.java:92)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-07-09 08:54:55,076 WARN [alert-dispatch:thread-1] [atlassian.diagnostics.internal.LockFreeAlertPublisher] run AlertListener com.atlassian.diagnostics.internal.PersistingAlertListener failed
com.atlassian.confluence.impl.osgi.OsgiNoServiceAvailableException: No service available for com.atlassian.sal.api.transaction.TransactionTemplate
at com.atlassian.confluence.impl.osgi.OsgiServiceRegistryImpl$ServiceTrackingProxy.invoke(OsgiServiceRegistryImpl.java:89)
at com.sun.proxy.$Proxy166.execute(Unknown Source)
at com.atlassian.diagnostics.internal.PersistingAlertListener.onAlert(PersistingAlertListener.java:24)
at com.atlassian.diagnostics.internal.LockFreeAlertPublisher$AlertListenerInvoker.run(LockFreeAlertPublisher.java:92)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-07-09 08:54:58,007 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.plugin.jslibs', not ACTIVE
2020-07-09 08:54:58,115 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.confluence.plugins.confluence-icons', not ACTIVE
2020-07-09 08:54:58,147 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.confluence.plugins.confluence-editor-v4', not ACTIVE
2020-07-09 08:54:58,248 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'org.apache.servicemix.bundles.spring-tx-4.3.20.RELEASE_1', not ACTIVE
2020-07-09 08:54:58,248 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'org.apache.servicemix.bundles.spring-jdbc-4.3.20.RELEASE_1', not ACTIVE
2020-07-09 08:54:58,403 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.springsource.net.jcip.annotations-1.0.0', not ACTIVE
2020-07-09 08:54:58,548 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.plugins.atlassian-spring-interceptor-adapter-plugin-1.1', not ACTIVE
2020-07-09 08:54:58,552 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.plugin.atlassian-spring-scanner-runtime', not ACTIVE
2020-07-09 08:54:58,552 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.plugin.atlassian-spring-scanner-annotation', not ACTIVE
2020-07-09 08:54:58,554 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.oauth.atlassian-oauth-api-4.0.0', not ACTIVE
2020-07-09 08:54:58,562 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.gadgets.atlassian-gadgets-spi-4.3.2', not ACTIVE
2020-07-09 08:54:58,563 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.gadgets.atlassian-gadgets-api-4.3.2', not ACTIVE
2020-07-09 08:55:00,702 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.bundles.json-20070829.0.0.1', not ACTIVE
2020-07-09 08:55:00,702 WARN [FelixStartLevel] [plugin.osgi.factory.OsgiBundlePlugin] disableInternal Cannot disable Bundle 'com.atlassian.bundles.icu4j-3.8.0.1', not ACTIVE
2020-07-09 08:55:01,504 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:01,588 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:01,687 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:01,849 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:01,876 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:01,892 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:02,060 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:02,368 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:02,569 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:03,557 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:03,566 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:03,628 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:03,637 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:03,728 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:03,737 WARN [wiki.ucert.co.kr-startStop-3] [plugin.osgi.factory.OsgiBundlePlugin] uninstallInternal OSGi container not running or undefined: Will not remove bundle listener and will not close package admin service
2020-07-09 08:55:04,002 ERROR [wiki.ucert.co.kr-startStop-3] [hipchat.spacetoroom.service.SpaceToRoomNotificationService] hipChatNotifications Failed to obtain hipchat notifications for event com.atlassian.plugin.event.events.PluginFrameworkShutdownEvent@7d14af2c: service proxy has been destroyed
2020-07-09 08:55:04,003 WARN [wiki.ucert.co.kr-startStop-3] [confluence.util.profiling.DurationThresholdWarningTimingHelperFactory] logMessage Execution time for publishing event com.atlassian.plugin.event.events.PluginFrameworkShutdownEvent@7d14af2c took 16105 ms (warning threshold is 5000 ms)
2020-07-09 08:55:04,146 INFO [wiki.ucert.co.kr-startStop-3] [com.atlassian.confluence.lifecycle] destroy Shutting down long running task service
2020-07-09 08:55:04,156 INFO [wiki.ucert.co.kr-startStop-3] [com.atlassian.confluence.lifecycle] shutdownCacheManager Shutting down EhCache cache manager
2020-07-09 08:55:04,159 INFO [wiki.ucert.co.kr-startStop-3] [com.atlassian.confluence.lifecycle] contextDestroyed Stopping Confluence
2020-07-09 08:55:22,893 INFO [wiki.ucert.co.kr-startStop-1] [com.atlassian.confluence.lifecycle] contextInitialized Starting Confluence 6.15.2 [build 8100 based on commit hash 4410012ac87e845516b70bc69b6f7a893eabaa5a] - synchrony version 2.1.0-master-9d112c9d
2020-07-09 08:55:25,848 INFO [wiki.ucert.co.kr-startStop-1] [springframework.web.context.ContextLoader] initWebApplicationContext Root WebApplicationContext: initialization started
2020-07-09 08:55:28,318 INFO [wiki.ucert.co.kr-startStop-1] [com.atlassian.confluence.lifecycle] <init> Loading EhCache cache manager
2020-07-09 08:55:38,838 INFO [wiki.ucert.co.kr-startStop-1] [springframework.web.context.ContextLoader] initWebApplicationContext Root WebApplicationContext: initialization completed in 12989 ms
2020-07-09 08:55:39,559 INFO [wiki.ucert.co.kr-startStop-1] [atlassian.plugin.manager.DefaultPluginManager] earlyStartup Plugin system earlyStartup begun
2020-07-09 08:55:40,397 WARN [wiki.ucert.co.kr-startStop-1] [org.twdata.pkgscanner.ExportPackageListBuilder] logDuplicateWarning Package Scanner found duplicates for package 'javax.annotation' with different versions. Files: javax.annotation-api-1.3.2.jar and jsr305-3.0.1.jar
'/opt/atlassian/wiki/confluence/WEB-INF/lib/javax.annotation-api-1.3.2.jar'
'/opt/atlassian/wiki/confluence/WEB-INF/lib/jsr305-3.0.1.jar'
2020-07-09 08:55:49,316 WARN [ThreadPoolAsyncTaskExecutor::Thread 2] [spring.scanner.util.ProductFilterUtil] detectProduct Couldn't detect product, will use ProductFilter.ALL
2020-07-09 08:55:58,492 INFO [wiki.ucert.co.kr-startStop-1] [atlassian.plugin.manager.DefaultPluginManager] logTime Plugin system earlyStartup ended
2020-07-09 08:55:58,522 INFO [wiki.ucert.co.kr-startStop-1] [atlassian.plugin.manager.DefaultPluginManager] lateStartup Plugin system lateStartup begun
2020-07-09 08:56:00,967 WARN [ThreadPoolAsyncTaskExecutor::Thread 10] [client.eventfilter.whitelist.AnalyticsWhitelistModuleDescriptor] readPluginWhitelist No whitelist resource file found at [mediaviewer/lib/analytics-whitelist.json] in plugin [com.atlassian.confluence.plugins.confluence-previews] (bundle entry not found)
2020-07-09 08:56:00,967 WARN [ThreadPoolAsyncTaskExecutor::Thread 10] [client.eventfilter.whitelist.AnalyticsWhitelistModuleDescriptor] readPluginWhitelist No whitelist resource file found at [mediaviewer/lib/analytics-whitelist.json] in plugin [com.atlassian.confluence.plugins.confluence-previews] (null InputStream)
2020-07-09 08:56:02,327 INFO [ThreadPoolAsyncTaskExecutor::Thread 4] [plugins.synchrony.bootstrap.DefaultSynchronyProxyMonitor] <init> synchrony-proxy healthcheck url: http://127.0.0.1:8090/synchrony-proxy/healthcheck
2020-07-09 08:56:03,127 WARN [ThreadPoolAsyncTaskExecutor::Thread 4] [hql.internal.ast.HqlSqlWalker] generatePositionalParameter [DEPRECATION] Encountered positional parameter near line 1, column 93 in HQL: [FROM com.atlassian.confluence.impl.schedule.caesium.SchedulerClusteredJob t WHERE t.jobId = ?]. Positional parameter are considered deprecated; use named parameters or JPA-style positional parameters instead.
2020-07-09 08:56:03,213 INFO [ThreadPoolAsyncTaskExecutor::Thread 4] [service.stepexecutor.attachment.AttachmentMigrationExecutor] info Initialized attachment migration executor with concurrency = 5 and batch size = 20.
2020-07-09 08:56:03,220 INFO [ThreadPoolAsyncTaskExecutor::Thread 4] [migration.agent.queue.QueueBroker] info Started queue broker. Registered consumers: [com.atlassian.migration.agent.service.stepexecutor.impl.ExportExecutor@795d18ad, com.atlassian.migration.agent.service.stepexecutor.impl.UploadExecutor@3486242b, com.atlassian.migration.agent.service.stepexecutor.attachment.AttachmentMigrationExecutor@4f5d5ad1, com.atlassian.migration.agent.service.stepexecutor.impl.ImportExecutor@571086eb]
2020-07-09 08:56:05,152 WARN [SiteSummaryCalculator:thread-1] [hibernate.boot.internal.SessionFactoryOptionsBuilder] doLog org.hibernate.tool.schema.Action cannot be cast to java.lang.String Ignoring
2020-07-09 08:56:06,240 INFO [wiki.ucert.co.kr-startStop-1] [atlassian.plugin.manager.DefaultPluginManager] logTime Plugin system lateStartup ended
2020-07-09 08:56:09,231 INFO [lifecycle:thread-13] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] startup Starting Synchrony and enabling Collaborative Editing
2020-07-09 08:56:09,232 WARN [lifecycle:thread-3] [expose.jmx.schedule.JmxInstrumentSchedulerImpl] onStart atlassian-instrumentation-jmx expose scheduler started.
2020-07-09 08:56:09,324 INFO [synchrony-interop-executor:thread-1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] isSynchronyProxyEnabled proxy port present: true
2020-07-09 08:56:10,299 INFO [synchrony-interop-executor:thread-1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] debugPrintEnvironment Synchrony working dir: /var/atlassian/application-data/wiki
2020-07-09 08:56:10,299 INFO [synchrony-interop-executor:thread-1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] debugPrintEnvironment /opt/atlassian/wiki/jre/bin/java -classpath /opt/atlassian/wiki/temp/2.1.0-master-9d112c9d.jar:/opt/atlassian/wiki/confluence/WEB-INF/lib/mysql-connector-java-5.1.47.jar -Xss2048k -Xmx1g synchrony.core sql
2020-07-09 08:56:10,398 INFO [ListenableFutureAdapter-thread-1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] isSynchronyProxyEnabled proxy port present: true
2020-07-09 08:56:10,429 INFO [ListenableFutureAdapter-thread-1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] updateSynchronyConfiguration Synchrony External Base URL: https://wiki.ucert.co.kr/synchrony,https://wiki.ucert.co.kr/synchrony-proxy
2020-07-09 08:56:10,430 INFO [ListenableFutureAdapter-thread-1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] updateSynchronyConfiguration Synchrony External Service URL: https://wiki.ucert.co.kr/synchrony/v1
2020-07-09 08:56:10,431 INFO [ListenableFutureAdapter-thread-1] [plugins.synchrony.bootstrap.DefaultSynchronyProcessManager] updateSynchronyConfiguration Synchrony Internal Service URL: http://127.0.0.1:8091/synchrony/v1
2020-07-09 08:56:16,825 WARN [ListenableFutureAdapter-thread-1] [plugins.synchrony.config.DefaultSynchronyConfigurationManager] enableSharedDrafts [Collab editing plugin] Enabling Shared Drafts
2020-07-09 08:56:23,128 INFO [wiki.ucert.co.kr-startStop-1] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue Waiting to find if plugin dependent upgrades are required. Maximum wait time will be 90 seconds.
2020-07-09 08:56:23,129 INFO [wiki.ucert.co.kr-startStop-1] [confluence.upgrade.impl.DefaultUpgradeGate] waitForBooleanValue plugin dependent upgrades are required : false.
2020-07-09 08:56:24,370 INFO [Caesium-1-2] [atlassian.crowd.directory.DbCachingRemoteDirectory] synchroniseCache FULL synchronisation for directory [ 98305 ] starting
2020-07-09 08:56:24,577 INFO [Caesium-1-2] [directory.ldap.cache.RemoteDirectoryCacheRefresher] findAllRemoteUsers found [ 29 ] remote users in [ 192 ms ]
2020-07-09 08:56:24,624 INFO [Caesium-1-2] [atlassian.crowd.directory.DbCachingRemoteChangeOperations] deleteCachedUsersNotIn scanned and compared [ 29 ] users for delete in DB cache in [ 43ms ]
2020-07-09 08:56:24,624 INFO [Caesium-1-2] [atlassian.crowd.directory.DbCachingRemoteChangeOperations] deleteCachedUsersNotIn scanned for deleted users in [ 46ms ]
2020-07-09 08:56:24,637 INFO [Caesium-1-2] [atlassian.crowd.directory.DbCachingRemoteChangeOperations] getUsersToAddAndUpdate scanning [ 29 ] users to add or update
2020-07-09 08:56:24,639 INFO [Caesium-1-2] [atlassian.crowd.directory.DirectoryCacheImplUsingChangeOperations] addOrUpdateCachedUsers scanned and compared [ 29 ] users for update in DB cache in [ 8ms ]
2020-07-09 08:56:24,641 INFO [Caesium-1-2] [atlassian.crowd.directory.DirectoryCacheImplUsingChangeOperations] addOrUpdateCachedUsers synchronised [ 29 ] users in [ 10ms ]
2020-07-09 08:56:24,664 INFO [Caesium-1-2] [directory.ldap.cache.RemoteDirectoryCacheRefresher] findAllRemoteGroups found [ 11 ] remote groups in [ 23 ms ]
2020-07-09 08:56:24,672 INFO [Caesium-1-2] [atlassian.crowd.directory.DbCachingRemoteChangeOperations] deleteCachedGroupsNotIn scanned and compared [ 11 ] groups for delete in DB cache in [ 6ms ]
2020-07-09 08:56:24,674 INFO [Caesium-1-2] [atlassian.crowd.directory.DirectoryCacheImplUsingChangeOperations] addOrUpdateCachedGroups scanning [ 11 ] groups to add or update
2020-07-09 08:56:24,678 INFO [Caesium-1-2] [atlassian.crowd.directory.DbCachingRemoteChangeOperations] findGroupsToUpdate scanned and compared [ 11 ] groups for update in DB cache in [ 4ms ]
2020-07-09 08:56:24,680 INFO [Caesium-1-2] [atlassian.crowd.directory.DirectoryCacheImplUsingChangeOperations] addOrUpdateCachedGroups synchronized [ 11 ] groups in [ 6ms ]
2020-07-09 08:56:24,728 INFO [Caesium-1-2] [directory.ldap.cache.AbstractCacheRefresher] synchroniseAllGroupAttributes finished group attribute sync with 0 failures in [ 48ms ]
2020-07-09 08:56:24,775 INFO [Caesium-1-2] [atlassian.crowd.directory.DbCachingRemoteDirectory] synchroniseCache FULL synchronisation complete for directory [ 98305 ] in [ 405ms ]

[Nic Brough -Adaptavist-]

That is not the area of the log from when the error occurred.  You need to read the log at the point at which the error occurs, not just read the end of it - the system is doing other things and logs them too.