Poor performance calling the web pages

[Ralf Brinkmann]

We have our documententation for several technical documents in confluence. As the documentation is growing we are facing tremendous performance problems.

Calling a web page takes up to several minutes, and often a messages appears saying "Webpage is not responding". While scrolling, the page turns white, links in the page are dead. 

We assume that the problem is based on using "excerpt" and "excerpt-include",  the "code" module, and using several areas (Bereiche).

Is there a way to analyse the problem? Has the use of excerpt-include limits?

[Ralf Brinkmann]

We investigated further, but with almost no success. When we call a document on the client we can see that the confluence server is quite busy. The cpu load is around 60-80% for almost 60 Seconds. During this time the web client shows a frozen page and the loading symbol.
Then the load on the confluence server drops to 10-20%, and the client shows the web page without the table of content, and without the navigation part of the area on the left side. 

It takes another app. 40 Seconds and up to 3 time out messages until the webpage is usuable.
The load of the client (chrome) is after the "busy time" of the server a little higher, and shows 40-60%.

The atlassiaon-confluence profile log shows more then 4000 times "DefaultRenderer.renderWithResult". How can we finde out which rendering it is to analyse the most time consuming renderings?

2022-01-07 16:35:18,634 [http-nio-8090-exec-1]
[27555.1ms] - /display/DET/Detailkonzept++Magnus
[27066.0ms] - XW Interceptor: Before defaultStack: /pages/viewpage.action (ViewPageAction.execute())
[27044.8ms] - SpaceAwareInterceptor.intercept()
[27044.8ms] - PageAwareInterceptor.intercept()
[12.5ms] - PageManager.getPageWithComments()
[27029.8ms] - XW Interceptor: After defaultStack: /pages/viewpage.action (ViewPageAction.execute())
[27029.7ms] - XW Interceptor: After validatingStack: /pages/viewpage.action (ViewPageAction.execute())
[26711.1ms] - DefaultRenderer.render
[26711.0ms] - DefaultRenderer.renderWithResult
[5.5ms] - DefaultRenderer.render
[5.5ms] - DefaultRenderer.renderWithResult
[7.2ms] - DefaultRenderer.render
[7.1ms] - DefaultRenderer.renderWithResult
[4.1ms] - CommentManager.countUnresolvedComments()
[6.0ms] [count: 2, avg: 3.0ms] - DefaultRenderer.render
[5.9ms] [count: 2, avg: 3.0ms] - DefaultRenderer.renderWithResult
[25.6ms] - DefaultRenderer.render
[25.6ms] - DefaultRenderer.renderWithResult
[8.8ms] - DefaultRenderer.render
[8.7ms] - DefaultRenderer.renderWithResult
[1.3ms] - DefaultRenderer.render
[1.2ms] - DefaultRenderer.renderWithResult
[18.7ms] - DefaultRenderer.render
[18.7ms] - DefaultRenderer.renderWithResult
[7.8ms] - DefaultRenderer.render
[7.8ms] - DefaultRenderer.renderWithResult
[1.4ms] - DefaultRenderer.render
[1.4ms] - DefaultRenderer.renderWithResult
[2.4ms] [count: 2, avg: 1.2ms] - DefaultRenderer.render
[2.3ms] [count: 2, avg: 1.1ms] - DefaultRenderer.renderWithResult
[27.2ms] - DefaultRenderer.render
[27.2ms] - DefaultRenderer.renderWithResult
[17.2ms] - DefaultRenderer.render
[17.2ms] - DefaultRenderer.renderWithResult
[9.3ms] - DefaultRenderer.render
[9.2ms] - DefaultRenderer.renderWithResult
[4.7ms] - DefaultRenderer.render
[4.7ms] - DefaultRenderer.renderWithResult
[6.1ms] - DefaultRenderer.render
[6.1ms] - DefaultRenderer.renderWithResult
[3.4ms] - CommentManager.countUnresolvedComments()
[3.6ms] - DefaultRenderer.render
[3.6ms] - DefaultRenderer.renderWithResult
[86.3ms] - DefaultRenderer.render
[86.2ms] - DefaultRenderer.renderWithResult
[68.9ms] - DefaultRenderer.render
[68.9ms] - DefaultRenderer.renderWithResult
[55.0ms] - DefaultRenderer.render
[55.0ms] - DefaultRenderer.renderWithResult
[15.9ms] - DefaultRenderer.render
[15.9ms] - DefaultRenderer.renderWithResult
[4.0ms] - CommentManager.countUnresolvedComments()
[89.1ms] - DefaultRenderer.render
[89.1ms] - DefaultRenderer.renderWithResult
[75.3ms] - DefaultRenderer.render
[75.2ms] - DefaultRenderer.renderWithResult
[53.6ms] - DefaultRenderer.render
[53.6ms] - DefaultRenderer.renderWithResult
[18.8ms] - DefaultRenderer.render
[18.8ms] - DefaultRenderer.renderWithResult
[6.8ms] - DefaultRenderer.render
[6.8ms] - DefaultRenderer.renderWithResult
[175.9ms] - DefaultRenderer.render
[175.9ms] - DefaultRenderer.renderWithResult
[154.7ms] - DefaultRenderer.render
[154.6ms] - DefaultRenderer.renderWithResult
[25.4ms] - DefaultRenderer.render
[25.3ms] - DefaultRenderer.renderWithResult
[8.6ms] - DefaultRenderer.render
[8.6ms] - DefaultRenderer.renderWithResult
[3.3ms] - DefaultRenderer.render
[3.3ms] - DefaultRenderer.renderWithResult

[Pramodh M]

Hi @Ralf Brinkmann 

Welcome to Confluence!!

Here's a Performance Tuning guide you can follow to better serve your Confluence Site

https://confluence.atlassian.com/doc/performance-tuning-130289.html

Don't worry about any macros or number of it, focus on your server performance tuning

For monitoring, you can install the java-melody plugin

https://github.com/javamelody/jira-confluence-javamelody

https://confluence.atlassian.com/kb/best-practices-for-performance-troubleshooting-tools-652444218.html

Thanks

[Ralf Brinkmann]

Hello Parmodh

I will look into the links, thank you!

[Brant Schroeder]

@Ralf Brinkmann welcome to the Atlassian community 

The issue sounds like a server resource issue.  Have you worked with your server administrators to do some performance tuning?  Are you running on a VM?  Are you running a proxy? 

I would suggest starting here https://confluence.atlassian.com/doc/performance-tuning-130289.html

[Ralf Brinkmann]

Hello Brant,

our administrator has looked into th issue, but he could find a cause. The system is running on a VM. I will look into the link - thank you!

[Brant Schroeder]

@Ralf Brinkmann if you are on a VM you will need to also take a look at this.  I have seen VM issues also cause problems https://confluence.atlassian.com/conf79/running-confluence-in-a-virtualized-environment-1027129835.html

[Brant Schroeder]

@Ralf Brinkmann What is happening on the DB server when the server's CPU is spiked?

[Ralf Brinkmann]

Hello Brant,

the DB server is running on the same machine. so the load I have mentined is the same.

[Brant Schroeder]

@Ralf Brinkmann are there any long running queries when the slowness occurs?