Synchrony Repeatedly Restarts

[Patrick Twohig]

I'm looking over the various KB articles on this, and I haven't found a good answer to this.  I'm running Synchorny and it just keeps restarting.  The logs, pasted below, don't seem to tell me much other than it keeps restarting.

I do see attempts to connect to the localhost 127.0.0.1.  I suspect that it should be attempting to connect via the reverse-proxy address (confluence.mydomain.net) but I don't see anywhere to configure that.

==> atlassian-synchrony.log <==
2019-05-23 15:53:53,779 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Running QueryDSL sytem...
2019-05-23 15:53:53,870 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.querydsl.jdbc [info] connection pool test-connection-on-checkin: true idle-connection-test-period: 100 max-idle-time-excess-connections: 100 max-idle-time: 3600","ns":"synchrony.querydsl.jdbc","level":"info"}}
2019-05-23 15:53:53,878 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] MLog clients using slf4j logging.
2019-05-23 15:53:53,893 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Initializing c3p0-0.9.5.1 [built 16-June-2015 00:06:36 -0700; debug? true; trace: 10]
2019-05-23 15:53:53,926 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.event-bus [info] cluster membership transition","transition":{"type":"join","member":{"member-id":"local","host":null,"local?":true}},"ns":"synchrony.event-bus","level":"info"}}
2019-05-23 15:53:54,278 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"request":{"remote-addr":"127.0.0.1","uri":"/synchrony/heartbeat","request-method":"get","query-string":null},"response":{"status":200},"ns":"synchrony.middleware.logging","level":"info","message":"synchrony.middleware.logging [info] null"}}
2019-05-23 15:53:54,291 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"request":{"remote-addr":"127.0.0.1","uri":"/synchrony/jwt-key","request-method":"get","query-string":null},"response":{"status":200},"ns":"synchrony.middleware.logging","level":"info","message":"synchrony.middleware.logging [info] null"}}
2019-05-23 15:53:56,027 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.components.watch-pid [warn] PID 53182 has died. Terminating","ns":"synchrony.components.watch-pid","level":"warn"}}
2019-05-23 15:53:59,211 DEBUG [238:StdErrHandler [/usr/local/openjdk8/jre/bin/java]] WARNING: boolean? already refers to: #'clojure.core/boolean? in namespace: medley.core, being replaced by: #'medley.core/boolean?
2019-05-23 15:53:59,314 DEBUG [238:StdErrHandler [/usr/local/openjdk8/jre/bin/java]] WARNING: Inst already refers to: #'clojure.core/Inst in namespace: schema.core, being replaced by: #'schema.core/Inst
2019-05-23 15:54:02,324 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Running QueryDSL sytem...
2019-05-23 15:54:02,420 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.querydsl.jdbc [info] connection pool test-connection-on-checkin: true idle-connection-test-period: 100 max-idle-time-excess-connections: 100 max-idle-time: 3600","ns":"synchrony.querydsl.jdbc","level":"info"}}
2019-05-23 15:54:02,428 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] MLog clients using slf4j logging.
2019-05-23 15:54:02,443 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Initializing c3p0-0.9.5.1 [built 16-June-2015 00:06:36 -0700; debug? true; trace: 10]
2019-05-23 15:54:02,476 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.event-bus [info] cluster membership transition","transition":{"type":"join","member":{"member-id":"local","host":null,"local?":true}},"ns":"synchrony.event-bus","level":"info"}}
2019-05-23 15:54:04,567 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.components.watch-pid [warn] PID 53182 has died. Terminating","ns":"synchrony.components.watch-pid","level":"warn"}}
2019-05-23 15:54:07,845 DEBUG [239:StdErrHandler [/usr/local/openjdk8/jre/bin/java]] WARNING: boolean? already refers to: #'clojure.core/boolean? in namespace: medley.core, being replaced by: #'medley.core/boolean?
2019-05-23 15:54:07,947 DEBUG [239:StdErrHandler [/usr/local/openjdk8/jre/bin/java]] WARNING: Inst already refers to: #'clojure.core/Inst in namespace: schema.core, being replaced by: #'schema.core/Inst
2019-05-23 15:54:10,747 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Running QueryDSL sytem...
2019-05-23 15:54:10,820 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.querydsl.jdbc [info] connection pool test-connection-on-checkin: true idle-connection-test-period: 100 max-idle-time-excess-connections: 100 max-idle-time: 3600","ns":"synchrony.querydsl.jdbc","level":"info"}}
2019-05-23 15:54:10,828 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] MLog clients using slf4j logging.
2019-05-23 15:54:10,843 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Initializing c3p0-0.9.5.1 [built 16-June-2015 00:06:36 -0700; debug? true; trace: 10]
2019-05-23 15:54:10,876 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.event-bus [info] cluster membership transition","transition":{"type":"join","member":{"member-id":"local","host":null,"local?":true}},"ns":"synchrony.event-bus","level":"info"}}
2019-05-23 15:54:11,216 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"request":{"remote-addr":"127.0.0.1","uri":"/synchrony/heartbeat","request-method":"get","query-string":null},"response":{"status":200},"ns":"synchrony.middleware.logging","level":"info","message":"synchrony.middleware.logging [info] null"}}
2019-05-23 15:54:11,229 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"request":{"remote-addr":"127.0.0.1","uri":"/synchrony/jwt-key","request-method":"get","query-string":null},"response":{"status":200},"ns":"synchrony.middleware.logging","level":"info","message":"synchrony.middleware.logging [info] null"}}
2019-05-23 15:54:12,990 DEBUG [238:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.components.watch-pid [warn] PID 53182 has died. Terminating","ns":"synchrony.components.watch-pid","level":"warn"}}
2019-05-23 15:54:16,255 DEBUG [238:StdErrHandler [/usr/local/openjdk8/jre/bin/java]] WARNING: boolean? already refers to: #'clojure.core/boolean? in namespace: medley.core, being replaced by: #'medley.core/boolean?
2019-05-23 15:54:16,360 DEBUG [238:StdErrHandler [/usr/local/openjdk8/jre/bin/java]] WARNING: Inst already refers to: #'clojure.core/Inst in namespace: schema.core, being replaced by: #'schema.core/Inst
2019-05-23 15:54:19,162 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Running QueryDSL sytem...
2019-05-23 15:54:19,235 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.querydsl.jdbc [info] connection pool test-connection-on-checkin: true idle-connection-test-period: 100 max-idle-time-excess-connections: 100 max-idle-time: 3600","ns":"synchrony.querydsl.jdbc","level":"info"}}
2019-05-23 15:54:19,244 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] MLog clients using slf4j logging.
2019-05-23 15:54:19,262 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] Initializing c3p0-0.9.5.1 [built 16-June-2015 00:06:36 -0700; debug? true; trace: 10]
2019-05-23 15:54:19,338 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.event-bus [info] cluster membership transition","transition":{"type":"join","member":{"member-id":"local","host":null,"local?":true}},"ns":"synchrony.event-bus","level":"info"}}
2019-05-23 15:54:19,623 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"request":{"remote-addr":"127.0.0.1","uri":"/synchrony/heartbeat","request-method":"get","query-string":null},"response":{"status":200},"ns":"synchrony.middleware.logging","level":"info","message":"synchrony.middleware.logging [info] null"}}
2019-05-23 15:54:19,636 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"request":{"remote-addr":"127.0.0.1","uri":"/synchrony/jwt-key","request-method":"get","query-string":null},"response":{"status":200},"ns":"synchrony.middleware.logging","level":"info","message":"synchrony.middleware.logging [info] null"}}
2019-05-23 15:54:21,437 DEBUG [239:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.components.watch-pid [warn] PID 53182 has died. Terminating","ns":"synchrony.components.watch-pid","level":"warn"}}

[Ole DB]

Hi @Patrick Twohig ,

could you solve the problem? I ran in absolute the same thing.

As in your logs synchrony is terminating because it says the confluence process died. But this is not true.

deploy@confluence:~ % tail -f confluence-data/logs/atlassian-synchrony.log | grep pid
2019-07-19 14:45:34,666 DEBUG [162:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.components.watch-pid [warn] PID 32730 has died. Terminating","ns":"synchrony.components.watch-pid","level":"warn"}}
2019-07-19 14:45:50,434 DEBUG [176:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.components.watch-pid [warn] PID 32730 has died. Terminating","ns":"synchrony.components.watch-pid","level":"warn"}}
2019-07-19 14:46:05,904 DEBUG [196:StdOutHandler [/usr/local/openjdk8/jre/bin/java]] {"synchrony":{"message":"synchrony.components.watch-pid [warn] PID 32730 has died. Terminating","ns":"synchrony.components.watch-pid","level":"warn"}}
^C

deploy@confluence:~ % ps aux | grep java
deploy 34847 612.4 1.9 2707656 558680 - SJ 14:46 0:19.47 /usr/local/openjdk8/jre/bin/java -classpath /home/deploy/confluence/atlassian-confluence-6
deploy 32730 2.9 6.3 3979788 1834588 - IJ 14:44 3:58.72 /usr/local/openjdk8/bin/java -Djava.util.logging.config.file=/home/deploy/confluence/atlas
deploy 34853 0.0 0.0 6660 2468 1 S+J 14:46 0:00.00 grep java

 As you see the process with pid 32730 is running.

@Shannon S do you have any suggestion to solv the Problem?

Thanks

Ole

[Shannon S]

Hello Patrick,

Thank you for contacting us about this.

Can you tell me how you've configured Synchrony for your reverse proxy? I will send you a few things that I think might help, but please let me know if you've already reviewed these steps.

We have a few examples outlined below of how you might configure this on your instance. 

• Possible Confluence and Synchrony Configurations > With a reverse proxy

There was also a good thread on Community that my former colleague Ann helped with that you might find useful:

• Atlassian Community: How can I get Synchrony to work behind a reverse proxy?

Lastly, we do have a section of probably the same article you already reviewed but discusses potential issues with reverse proxy setup and Synchrony and how to fix it:

• Reverse Proxy Issues

Please feel free to review that but do feel free to provide any details on how you have configured the synchrony for the reverse proxy.

Regards,

Shannon