Roon crashes several times and is restarted by the watchdog

Core Machine (Operating system/System info/Roon build number)

Roon on QNAP

  • Model: QGD-1600P
  • Architecture: x86_64
  • Total Memory: 32786260
  • Available Memory: 25322328
  • QTS Version: 4.5.2 - Build: 20210302
  • PKG Version: 2021-02-01

Network Details (Including networking gear model/manufacturer and if on WiFi/Ethernet)

Central Switch All 1Gbit → QGD-1600P
4 Access points for wifi (aal of them 2.4 GHz and 5Ghz)
Harman Kardon speakers with Chromecast enabled (Stereo grouping) connected with Wifi

Audio Devices (Specify what device you’re using and its connection type - USB/HDMI/etc.)

Harman Kardon speakers with Chromecast enabled (Stereo grouping) connected with Wifi

Description Of Issue

It seems that Roon is frequently crashing or consuming all of te memory of the NAS (32 GByte).
The crashes are occur after:

26.03.21-15:02:53  --- at Enumerator:MoveNext <0x0000d>
26.03.21-15:02:53  --- at Sooloos.Broker.Remoting.RemotingServer:_Contains <0x000c3>
26.03.21-15:02:53  --- at Sooloos.Broker.Remoting.RemotingServer:_PutObject <0x00203>
26.03.21-15:02:53  --- at Sooloos.Broker.Remoting.RemotingServer:Sooloos.Broker.Remoting.IRemotingContext.PutObject <0x00043>
26.03.21-15:02:53  --- at Sooloos_Broker_Api_Zone_Adapter:Serialize <0x004c8>
26.03.21-15:02:53  --- at Sooloos.Broker.Remoting.RemotingServer:NotifyStateChange <0x0019b>
26.03.21-15:02:53  --- at Sooloos.Broker.Distributed.ServerConnection:OnAfterExit <0x000eb>
26.03.21-15:02:53  --- at Sooloos.SynchronizationContextThread:OnAfterExit <0x00042>
26.03.21-15:02:53  --- at Sooloos.SynchronizationContextThread:_Dispatch <0x0049e>
26.03.21-15:02:53  --- at Sooloos.SynchronizationContextThread:_Go <0x0008b>
26.03.21-15:02:53  --- at System.Threading.ThreadHelper:ThreadStart_Context <0x000aa>
26.03.21-15:02:53  --- at System.Threading.ExecutionContext:RunInternal <0x001ae>
26.03.21-15:02:53  --- at System.Threading.ExecutionContext:Run <0x00043>
26.03.21-15:02:53  --- at System.Threading.ExecutionContext:Run <0x00063>
26.03.21-15:02:53  --- at System.Threading.ThreadHelper:ThreadStart <0x00043>
26.03.21-15:02:53  --- at System.Object:runtime_invoke_void__this__ <0x00085>

The growing memory usages happened after:
03/26 11:53:09 Critical: scx: in OnAfterExit: System.NullReferenceException: Object reference not set to an instance of an object
at System.Collections.Generic.List1+Enumerator[T].MoveNext () <0x418ba410 + 0x0000d> in <49e2691b1d1a45389d419b3a01a2b89a>:0 at Sooloos.Broker.Remoting.RemotingServer._Contains (System.Collections.Generic.List1[T] os, System.Object o) [0x00017] in :0
at Sooloos.Broker.Remoting.RemotingServer._PutObject (System.Object o, System.IO.Stream stream, System.Boolean inline) [0x0007c] in :0
at Sooloos.Broker.Remoting.RemotingServer.Sooloos.Broker.Remoting.IRemotingContext.PutObject (System.Object o, System.IO.Stream stream, System.Boolean inline) [0x00000] in :0
at Sooloos_Broker_Api_Transport_Adapter.Serialize (System.Object obj, System.IO.Stream stream) [0x00025] in :0
at Sooloos.Broker.Remoting.RemotingServer.NotifyStateChange (System.Object o) [0x00034] in :0
at Sooloos.Broker.Distributed.ServerConnection.OnAfterExit () [0x00019] in :0
at Sooloos.SynchronizationContextThread.OnAfterExit () [0x0000a] in <1bd91944b74b447389c5da46010288ed>:0

It looks like there is a relation between the crashes and memory growing issue. It looks like the same components.

After the recent update still having the same problems. Roon is stil crashing with an exception error and restarting by watchdog. I have added a part of the log files containing the error:

07.04.21-16:20:09  --- 
07.04.21-16:20:09  --- =================================================================
07.04.21-16:20:09  --- Native Crash Reporting
07.04.21-16:20:09  --- =================================================================
07.04.21-16:20:09  --- Got a SIGSEGV while executing native code. This usually indicates
07.04.21-16:20:09  --- a fatal error in the mono runtime or one of the native libraries
07.04.21-16:20:09  --- used by your application.
07.04.21-16:20:09  --- =================================================================
07.04.21-16:20:09  --- 
07.04.21-16:20:09  --- =================================================================
07.04.21-16:20:09  --- Native stacktrace:
07.04.21-16:20:09  --- =================================================================
07.04.21-16:20:09  --- 0x5098ec - /share/CACHEDEV1_DATA/.qpkg/RoonServer/RoonServer/RoonMono/bin/RoonAppliance :
07.04.21-16:20:09  --- 0x509d17 - /share/CACHEDEV1_DATA/.qpkg/RoonServer/RoonServer/RoonMono/bin/RoonAppliance :
07.04.21-16:20:09  --- 0x470941 - /share/CACHEDEV1_DATA/.qpkg/RoonServer/RoonServer/RoonMono/bin/RoonAppliance :
07.04.21-16:20:09  --- 0x42577d - /share/CACHEDEV1_DATA/.qpkg/RoonServer/RoonServer/RoonMono/bin/RoonAppliance :
07.04.21-16:20:09  --- 0x4257ba - /share/CACHEDEV1_DATA/.qpkg/RoonServer/RoonServer/RoonMono/bin/RoonAppliance :
07.04.21-16:20:09  --- 0x7f36292cf6f0 - /lib/libpthread.so.0 :
07.04.21-16:20:09  --- 0x41a9541d - Unknown
07.04.21-16:20:09  --- 
07.04.21-16:20:09  --- =================================================================
07.04.21-16:20:09  --- Telemetry Dumper:
07.04.21-16:20:09  --- =================================================================
07.04.21-16:20:09  --- Pkilling 0x7f3584107700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35ca7e6700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3584d66700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361f240700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35ca9e7700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361d172700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361cc43700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f36242ff700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3624083700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35caff1700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359b1f8700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c90e5700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361c2bf700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f355d7ff700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361fdfe700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361c7a1700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35788ff700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359b3f9700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361f643700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c8add700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c92e6700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361c4c0700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361ffff700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c984c700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f357753b700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359b5fa700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c8cde700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c94e7700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361d1b3700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c9a4d700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3583702700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359b7fb700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3567abb700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361ce9c700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35c9c4e700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3583903700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3591db7700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359b9fc700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361d09d700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35630ff700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35cbdfe700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35889d1700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35cabec700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3583b04700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359bbfd700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35a2efe700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f362577b700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35a03a3700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3583d05700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359bdfe700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f362a016740 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f358d351700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361d1f4700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361ee3e700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3624042700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f3583f06700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f359bfff700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f35652df700 from 0x7f35c8137700
07.04.21-16:20:09  --- Pkilling 0x7f361f03f700 from 0x7f35c8137700
07.04.21-16:20:09  --- Could not exec mono-hang-watchdog, expected on path '/share/CACHEDEV1_DATA/.qpkg/RoonServer/RoonServer/RoonMono/etc/../bin/mono-hang-watchdog' (errno 2)
07.04.21-16:20:09  --- Entering thread summarizer pause from 0x7f35c8137700
07.04.21-16:20:09  --- Finished thread summarizer pause from 0x7f35c8137700.
07.04.21-16:20:09  --- Failed to create breadcrumb file (null)/crash_hash_0x923cf03b7
07.04.21-16:20:09  --- 
07.04.21-16:20:09  --- Waiting for dumping threads to resume
07.04.21-16:20:10  --- 
07.04.21-16:20:10  --- =================================================================
07.04.21-16:20:10  --- Basic Fault Address Reporting
07.04.21-16:20:10  --- =================================================================
07.04.21-16:20:10  --- Memory around native instruction pointer (0x41a9541d):0x41a9540d  00 00 00 48 83 ec 28 4c 89 34 24 4c 89 7c 24 08  ...H..(L.4$L.|$.
07.04.21-16:20:10  --- 0x41a9541d  4c 89 54 24 10 4c 8b ff b8 78 8d ca 00 f7 00 01  L.T$.L...x......
07.04.21-16:20:10  --- 0x41a9542d  00 00 00 74 06 90 e8 e8 80 26 00 4d 8b 37 49 63  ...t.....&.M.7Ic
07.04.21-16:20:10  --- 0x41a9543d  47 0c 49 63 4e 24 3b c1 0f 85 69 00 00 00 49 63  G.IcN$;...i...Ic
07.04.21-16:20:10  --- 
07.04.21-16:20:10  --- =================================================================
07.04.21-16:20:10  --- Managed Stacktrace:
07.04.21-16:20:10  --- =================================================================
07.04.21-16:20:10  --- at Enumerator:MoveNext <0x0000d>
07.04.21-16:20:10  --- at Sooloos.Broker.Distributed.ServerConnection:OnBeforeEntry <0x000f3>
07.04.21-16:20:10  --- at Sooloos.SynchronizationContextThread:OnBeforeEntry <0x00042>
07.04.21-16:20:10  --- at Sooloos.SynchronizationContextThread:_Dispatch <0x00075>
07.04.21-16:20:10  --- at Sooloos.SynchronizationContextThread:_Go <0x0008b>
07.04.21-16:20:10  --- at System.Threading.ThreadHelper:ThreadStart_Context <0x000a5>
07.04.21-16:20:10  --- at System.Threading.ExecutionContext:RunInternal <0x001ae>
07.04.21-16:20:10  --- at System.Threading.ExecutionContext:Run <0x00043>
07.04.21-16:20:10  --- at System.Threading.ExecutionContext:Run <0x00063>
07.04.21-16:20:10  --- at System.Threading.ThreadHelper:ThreadStart <0x00043>
07.04.21-16:20:10  --- at System.Object:runtime_invoke_void__this__ <0x00085>
07.04.21-16:20:10  --- =================================================================
07.04.21-16:20:10  --- Error
07.04.21-16:20:12  --- Initializing
07.04.21-16:20:12  --- Started
07.04.21-16:20:14  --- Not responding
07.04.21-16:20:19  --- Running

I see a lot of issues with a crashing RoonServer, I think a lot are related to each other. Most of the times the user notice a crash during a play back or a handling. But i think that the servers are continuous crashing over the day. A least when i invest the log files I see that the RoonServer is crashing approximately two times a day and all crashes are happening on the same point of code.

I think there is a general software bug that occurs at least on the Linux platforms (Nucleus, QNAP and other). The crashes are not noticed on the regular RoonServer log, but can be viewed for the QNAP devies under: ROONSERVER_QNAP_LOG.txt

I think the problem is bigger, because the RoonServer is restarting by the watchdog.

I can’t see any crashes on my installation’s ROONSERVER_QNAP_LOG.txt. So maybe not so much a general software bug?

Indeed that sound not as general software bug. Do you have a Qobuz subscription?What I will try is to remove my Qobuz subscription for a while and see if the crashes disappear.

I don’t use any streaming service.

Maybe there is some clue. I see more issues with random/several crashes in combination with Qobuz. Maybe some (strange) responses from Qobuz that is not handled well in Roon.

Hey @Bart_Ratgers,

Thank you so much for keeping us updated as things unfolded since the time you first posted. I am so sorry we were unresponsive for so long :pleading_face:

While we are trying to reply to everyone as fast as we can, response times are much longer than we had hoped…

I’ve moved this thread into our technical team’s queue, so they can take a look at what you’ve just shared. In the meantime, if you have any other updates, would you be so kind as to post a reply :pray: ?