Frequent crashing since v1.8 build 918

Roon Core Machine

Linux Roon 5.10.0-11-amd64 #1 SMP Debian 5.10.92-1 (2022-01-18) x86_64

me@Roon:~$ lscpu
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   44 bits physical, 48 bits virtual
CPU(s):                          4
On-line CPU(s) list:             0-3
Thread(s) per core:              2
Core(s) per socket:              2
Socket(s):                       1
NUMA node(s):                    1
Vendor ID:                       AuthenticAMD
CPU family:                      23
Model:                           8
Model name:                      AMD Ryzen Threadripper 2970WX 24-Core Processor
Stepping:                        2
CPU MHz:                         3000.042
BogoMIPS:                        6000.08
Hypervisor vendor:               Microsoft
Virtualization type:             full
L1d cache:                       64 KiB
L1i cache:                       128 KiB
L2 cache:                        1 MiB
L3 cache:                        8 MiB

8GB RAM

Networking Gear & Setup Details

D-Link DGS-1024D 24-Port Unmanaged Gigabit Switch
Ethernet cat6 wired using DHCP reservations /22 LAN

Connected Audio Devices

Pro-Ject DAC Box E via WASAPI driver
Windows 10 pro x64 client

Number of Tracks in Library

17,547 Tracks

Description of Issue

I’m a new subscriber with a new, purpose built, linux based roon server. During the trial period things seemed to be pretty stable. Unfortunately stability is causing me great concern as of late.

While streaming Tidal I am encountering frequent crashes of what seems to be the roon server. I have been encountering more frequent crashing over the last week, so I set up a cron job to gracefully restart Roon at 5am each day. That seemed to help but now the crashing is more frequent, I cannot typically make it through two songs without (I assume) the server app crashing. So I set up a watchdog process to automatically restart the Roon services on my dedicated linux server when they crash. That is working but the crashing is getting worse… I’m not sure what else to try since the crashing is more consistent each time I stream songs in roon from tidal. Any help is greatly appreciated!!! Thank you in advance.

Here are some logs of when it happened.
RoonServer_log.01.txt

03/24 12:22:10 Info: 
--[ SignalPath ]---------------------------------------------
SignalPath Quality = Lossless
Elements:
    Source Format=Flac 48000/24/2  Quality=Lossless MQA 192000
    MQA Subtype=authentication LightState=off OriginalSampleRate=48000 OutputSampleRate= OutputBitsPerSample=
    MQA Subtype=roon_core_decoder LightState= OriginalSampleRate= OutputSampleRate=96000 OutputBitsPerSample=24
    Raat Device=Realtek(R) Audio
    Output OutputType=Local_ExclusiveMode_Wasapi Quality=Lossless SubType= Model=Realtek(R) Audio
------------------------------------------------------------
03/24 12:22:11 Info: 
--[ SignalPath ]---------------------------------------------
SignalPath Quality = Lossless
Elements:
    Source Format=Flac 48000/24/2  Quality=Lossless MQA 192000
    MQA Subtype=authentication LightState=authored OriginalSampleRate=192000 OutputSampleRate= OutputBitsPerSample=
    MQA Subtype=roon_core_decoder LightState= OriginalSampleRate= OutputSampleRate=96000 OutputBitsPerSample=24
    Raat Device=Realtek(R) Audio
    Output OutputType=Local_ExclusiveMode_Wasapi Quality=Lossless SubType= Model=Realtek(R) Audio
------------------------------------------------------------
03/24 12:22:15 Trace: [DAC Box E] [Lossless 23.0x, 24/48 MQA TIDAL FLAC => 24/96] [100% buf] [PLAYING @ 0:04/3:22] Those Sweet Words - Norah Jones / Lee Alexander / Richard Julian
03/24 12:22:16 Info: [stats] 26780mb Virtual, 5203mb Physical, 3090mb Managed, 330 Handles, 92 Threads
03/24 12:22:18 Debug: [easyhttp] [1681] POST to https://device-map.roonlabs.net/1/register returned after 246 ms, status code: 200
03/24 12:22:18 Trace: [devicemap] device map updated
03/24 12:22:19 Debug: FTMSI-B-OE ti/9E35B34B exit thread signalled
03/24 12:22:19 Debug: FTMSI-B ti/9E35B34B download status: AllBlocksDownloaded accessTimeout:False openFiles:1 prev:(FirstBlockRetrieved,False,1)
03/24 12:22:19 Info: FTMSI-B ti/9E35B34B: allocated bw changed from 51200 to 0 kbps
03/24 12:22:19 Info: FTMSI-B 1 FileCache ti/B5AD0AB1 dwStatus:AllBlocksDownloaded files:0 accessTimeOut:True priorities: ('zoneplayer:11':1) ('zoneplayer:10':3) --> bw limit:0kbps
03/24 12:22:19 Info: FTMSI-B 2 FileCache ti/707C2863 dwStatus:AllBlocksDownloaded files:0 accessTimeOut:True priorities: ('zoneplayer:11':2) ('zoneplayer:10':4) --> bw limit:0kbps
03/24 12:22:19 Info: FTMSI-B 3 FileCache ti/69532C5D dwStatus:AllBlocksDownloaded files:1 accessTimeOut:True priorities: ('zoneplayer:10':16) --> bw limit:0kbps
03/24 12:22:19 Info: FTMSI-B 4 FileCache ti/9E35B34B dwStatus:AllBlocksDownloaded files:1 accessTimeOut:False priorities: ('zoneplayer:10':15) --> bw limit:0kbps
03/24 12:22:19 Debug: FTMSI-B-OE ti/9E35B34B rid:1 request ended -- first block: 0 blocks read: 1178 download speed: 31469kbps response time: 51ms
03/24 12:22:21 Trace: [DAC Box E] [Lossless 26.7x, 24/48 MQA TIDAL FLAC => 24/96] [100% buf] [PLAYING @ 0:09/3:22] Those Sweet Words - Norah Jones / Lee Alexander / Richard Julian



And here is the RAATServer_log.01.txt part that might help:
03/24 07:45:30 Info: Starting RAATServer v1.8 (build 918) stable on linuxx64
03/24 07:45:30 Trace: [RAATServer] detected ALSA support
03/24 07:45:30 Trace: [bits] myinfo: {"os":"Linux 5.10.0-11-amd64","platform":"linuxx64","machineversion":100800918,"branch":"stable","appmodifier":"","appname":"RAATServer"}
03/24 07:45:31 Debug: [easyhttp] [1] POST to https://bits.roonlabs.net/1/q/roon.base.,roon.internet_discovery. returned after 809 ms, status code: 200
03/24 07:45:31 Trace: [bits] updated bits, in 864ms
03/24 07:45:31 Info: [RAATServer] creating RAAT__manager
03/24 07:45:31 Info: [RAATServer]     appdata_dir  = /var/roon/RAATServer
03/24 07:45:31 Info: [RAATServer]     unique_id    = 4f1fdb64-cd33-4d7b-9772-c0bac390f7e1
03/24 07:45:31 Info: [RAATServer]     machine_id   = bbf73b5e-3696-6425-f723-c577dcf1e5d2
03/24 07:45:31 Info: [RAATServer]     machine_name = Roon
03/24 07:45:31 Info: [RAATServer]     os_version   = Linux 5.10.0-11-amd64
03/24 07:45:31 Info: [RAATServer]     vendor       = 
03/24 07:45:31 Info: [RAATServer]     model        = 
03/24 07:45:31 Info: [RAATServer]     service_id   = d7634b85-8190-470f-aa51-6cb5538dc1b9
03/24 07:45:31 Info: [RAATServer]     is_dev       = False
03/24 07:45:31 Trace: [raatmanager] starting
03/24 07:45:31 Trace: [raatmanager] initialized
03/24 07:45:31 Info: [RAATServer] running RAAT__manager
03/24 07:45:31 Trace: [raatmanager] starting discovery
03/24 07:45:31 Trace: [discovery] starting
03/24 07:45:31 Info: [discovery] [iface:lo:127.0.0.1] multicast recv socket is bound to 0.0.0.0:9003
03/24 07:45:31 Info: [discovery] [iface:lo:127.0.0.1] multicast send socket is bound to 0.0.0.0:46393
03/24 07:45:31 Info: [discovery] [iface:eth0:192.168.1.18] multicast recv socket is bound to 0.0.0.0:9003
03/24 07:45:31 Info: [discovery] [iface:eth0:192.168.1.18] multicast send socket is bound to 0.0.0.0:55679
03/24 07:45:31 Info: [discovery] unicast socket is bound to 0.0.0.0:9003
03/24 07:45:31 Trace: [raatmanager] starting server
03/24 07:45:31 Info: [jsonserver] listening on port 9200
03/24 07:45:31 Trace: [raatmanager] announcing
03/24 07:45:31 Debug: [discovery] broadcast op is complete
03/24 07:45:32 Trace: [inetdiscovery] added device raatserver/4f1fdb64-cd33-4d7b-9772-c0bac390f7e1 in addr:__ADDR__
03/24 07:45:32 Trace: [inetdiscovery] added service com.roonlabs.raatserver.tcp for device raatserver/4f1fdb64-cd33-4d7b-9772-c0bac390f7e1
03/24 07:45:37 Trace: [ipaddresses] enumerating addresses
03/24 07:45:37 Trace: [ipaddresses]    FOUND   lo 127.0.0.1
03/24 07:45:37 Trace: [ipaddresses]    FOUND   eth0 192.168.1.18
03/24 07:45:37 Debug: [easyhttp] [2] POST to https://discovery.roonlabs.net/1/register returned after 164 ms, status code: 200
03/24 07:45:37 Trace: [inetdiscovery] registered 1 devices, 1 services
03/24 07:45:42 Trace: [RAATServer] refreshing @ 10s
03/24 07:45:42 Trace: [raatmanager] announcing
03/24 07:45:42 Debug: [discovery] broadcast op is complete
03/24 07:46:07 Trace: [jsonserver] [127.0.0.1:53754] accepted connection
03/24 07:46:07 Trace: [jsonserver] [127.0.0.1:53754] GOT[LL] [1] {"request":"enumerate_devices","subscription_id":"0"}
03/24 07:46:07 Trace: [jsonserver] [127.0.0.1:53754] SENT [1] [nonfinal] {"status": "Success", "devices": []}
03/24 07:49:05 Warn: [jsonserver] client timed out after 10013ms (timeout=10000)
03/24 07:49:05 Trace: [jsonserver] [127.0.0.1:53754] destroying client
03/24 07:49:17 Trace: [jsonserver] [127.0.0.1:55030] accepted connection
03/24 07:49:17 Trace: [jsonserver] [127.0.0.1:55030] GOT[LL] [1] {"request":"enumerate_devices","subscription_id":"0"}
03/24 07:49:17 Trace: [jsonserver] [127.0.0.1:55030] SENT [1] [nonfinal] {"status": "Success", "devices": []}
03/24 07:53:01 Warn: [jsonserver] client timed out after 10021ms (timeout=10000)
03/24 07:53:01 Trace: [jsonserver] [127.0.0.1:55030] destroying client
03/24 07:53:02 Trace: [jsonserver] [127.0.0.1:56178] accepted connection
03/24 07:53:02 Trace: [jsonserver] [127.0.0.1:56178] GOT[LL] [1] {"request":"enumerate_devices","subscription_id":"0"}
03/24 07:53:02 Trace: [jsonserver] [127.0.0.1:56178] SENT [1] [nonfinal] {"status": "Success", "devices": []}
03/24 08:48:19 Warn: [jsonserver] client timed out after 10448ms (timeout=10000)
03/24 08:48:19 Trace: [jsonserver] [127.0.0.1:56178] destroying client
03/24 08:48:20 Trace: [jsonserver] [127.0.0.1:43678] accepted connection
03/24 08:48:20 Trace: [jsonserver] [127.0.0.1:43678] GOT[LL] [1] {"request":"enumerate_devices","subscription_id":"0"}
03/24 08:48:20 Trace: [jsonserver] [127.0.0.1:43678] SENT [1] [nonfinal] {"status": "Success", "devices": []}
03/24 09:45:37 Debug: [easyhttp] [3] POST to https://discovery.roonlabs.net/1/register returned after 442 ms, status code: 200
03/24 09:45:37 Trace: [inetdiscovery] registered 1 devices, 1 services
03/24 10:11:50 Trace: [RAATServer] network reachability changed, refreshing discovery
03/24 10:11:50 Trace: [raatmanager] updating network interfaces
03/24 10:11:50 Trace: [discovery] stopping
03/24 10:11:50 Trace: closing multicast
03/24 10:11:50 Trace: [discovery] closing unicast send socket
03/24 10:11:50 Trace: [discovery] closing unicast recv socket
03/24 10:11:50 Trace: [discovery] starting
03/24 10:11:50 Info: [discovery] [iface:lo:127.0.0.1] multicast recv socket is bound to 0.0.0.0:9003
03/24 10:11:50 Info: [discovery] [iface:lo:127.0.0.1] multicast send socket is bound to 0.0.0.0:57746
03/24 10:11:50 Info: [discovery] [iface:eth0:192.168.1.18] multicast recv socket is bound to 0.0.0.0:9003
03/24 10:11:50 Info: [discovery] [iface:eth0:192.168.1.18] multicast send socket is bound to 0.0.0.0:44451
03/24 10:11:50 Info: [discovery] unicast socket is bound to 0.0.0.0:9003
03/24 10:11:50 Trace: [raatmanager] announcing
03/24 10:11:50 Debug: [discovery] broadcast op is complete
03/24 10:11:55 Debug: [easyhttp] [4] POST to https://discovery.roonlabs.net/1/register returned after 649 ms, status code: 200
03/24 10:11:55 Trace: [inetdiscovery] registered 1 devices, 1 services
03/24 12:22:26 Trace: [jsonserver] [127.0.0.1:43678] read error: connection reset by peer
03/24 12:22:27 Trace: [jsonserver] [127.0.0.1:43678] destroying client

Any help or acknowledgment is appreciated. I’m happy to provide any additional information as well. Roon is unusable in the current state (for me) and difficult to justify the subscription fee.

Providing additional crash logs from this morning. I made it through about 8 songs before the client/server disconnected/crashed. This time I was using a chromecast ultra as a display, and chromecast audio → optical → bifrost2 to stream music in roon using tidal as a source. The Roon Server log seems to indicate a timeout from my phone (Pixel5). I can confirm that the chromecast Ultra display device stopped displaying the album about 4 songs into the playlist, but I was ok with that since the music was still streaming from the audio device (chromecast audio). Something made the music stop at about 8:09am. Here is a screen shot of the server top memory which shows RoonAppliance up for almost 5 minutes, my watchdog process must have restarted it after it stopped. I’ve included additional parts of the logs that might help. I’m also setting up a remote monitoring agent to capture some server metrics like CPU, Memory, and swap. When this happens again I’ll reply back with the logs and screen shots of the metrics.

RAATServer_log.txt

03/25 08:05:43 Info: Starting RAATServer v1.8 (build 918) stable on linuxx64
03/25 08:05:43 Trace: [RAATServer] detected ALSA support
03/25 08:05:43 Trace: [bits] myinfo: {"os":"Linux 5.10.0-11-amd64","platform":"linuxx64","machineversion":100800918,"branch":"stable","appmodifier":"","appname":"RAATServer"}
03/25 08:05:44 Debug: [easyhttp] [1] POST to https://bits.roonlabs.net/1/q/roon.base.,roon.internet_discovery. returned after 730 ms, status code: 200
03/25 08:05:44 Trace: [bits] updated bits, in 801ms
03/25 08:05:44 Info: [RAATServer] creating RAAT__manager
03/25 08:05:44 Info: [RAATServer]     appdata_dir  = /var/roon/RAATServer
03/25 08:05:44 Info: [RAATServer]     unique_id    = 4f1fdb64-cd33-4d7b-9772-c0bac390f7e1
03/25 08:05:44 Info: [RAATServer]     machine_id   = bbf73b5e-3696-6425-f723-c577dcf1e5d2
03/25 08:05:44 Info: [RAATServer]     machine_name = Roon
03/25 08:05:44 Info: [RAATServer]     os_version   = Linux 5.10.0-11-amd64
03/25 08:05:44 Info: [RAATServer]     vendor       = 
03/25 08:05:44 Info: [RAATServer]     model        = 
03/25 08:05:44 Info: [RAATServer]     service_id   = d7634b85-8190-470f-aa51-6cb5538dc1b9
03/25 08:05:44 Info: [RAATServer]     is_dev       = False
03/25 08:05:44 Trace: [raatmanager] starting
03/25 08:05:44 Trace: [raatmanager] initialized
03/25 08:05:44 Info: [RAATServer] running RAAT__manager
03/25 08:05:44 Trace: [raatmanager] starting discovery
03/25 08:05:44 Trace: [discovery] starting
03/25 08:05:44 Info: [discovery] [iface:lo:127.0.0.1] multicast recv socket is bound to 0.0.0.0:9003
03/25 08:05:44 Info: [discovery] [iface:lo:127.0.0.1] multicast send socket is bound to 0.0.0.0:40884
03/25 08:05:44 Info: [discovery] [iface:eth0:192.168.1.18] multicast recv socket is bound to 0.0.0.0:9003
03/25 08:05:44 Info: [discovery] [iface:eth0:192.168.1.18] multicast send socket is bound to 0.0.0.0:37927
03/25 08:05:44 Info: [discovery] unicast socket is bound to 0.0.0.0:9003
03/25 08:05:44 Trace: [raatmanager] starting server
03/25 08:05:44 Info: [jsonserver] listening on port 9200
03/25 08:05:44 Trace: [raatmanager] announcing
03/25 08:05:44 Debug: [discovery] broadcast op is complete
03/25 08:05:45 Trace: [inetdiscovery] added device raatserver/4f1fdb64-cd33-4d7b-9772-c0bac390f7e1 in addr:__ADDR__
03/25 08:05:45 Trace: [inetdiscovery] added service com.roonlabs.raatserver.tcp for device raatserver/4f1fdb64-cd33-4d7b-9772-c0bac390f7e1
03/25 08:05:50 Trace: [ipaddresses] enumerating addresses
03/25 08:05:50 Trace: [ipaddresses]    FOUND   lo 127.0.0.1
03/25 08:05:50 Trace: [ipaddresses]    FOUND   eth0 192.168.1.18
03/25 08:05:50 Debug: [easyhttp] [2] POST to https://discovery.roonlabs.net/1/register returned after 169 ms, status code: 200
03/25 08:05:50 Trace: [inetdiscovery] registered 1 devices, 1 services
03/25 08:05:55 Trace: [RAATServer] refreshing @ 10s
03/25 08:05:55 Trace: [raatmanager] announcing
03/25 08:05:55 Debug: [discovery] broadcast op is complete
03/25 08:06:21 Trace: [jsonserver] [127.0.0.1:48530] accepted connection
03/25 08:06:21 Trace: [jsonserver] [127.0.0.1:48530] GOT[LL] [1] {"request":"enumerate_devices","subscription_id":"0"}
03/25 08:06:21 Trace: [jsonserver] [127.0.0.1:48530] SENT [1] [nonfinal] {"status": "Success", "devices": []}
03/25 08:09:21 Warn: [jsonserver] client timed out after 10343ms (timeout=10000)
03/25 08:09:21 Trace: [jsonserver] [127.0.0.1:48530] destroying client
03/25 08:09:45 Trace: [jsonserver] [127.0.0.1:49908] accepted connection
03/25 08:09:46 Trace: [jsonserver] [127.0.0.1:49908] GOT[LL] [1] {"request":"enumerate_devices","subscription_id":"0"}
03/25 08:09:46 Trace: [jsonserver] [127.0.0.1:49908] SENT [1] [nonfinal] {"status": "Success", "devices": []}

RoonServer_log.txt

03/25 08:09:48 Info: [transport] creating endpoint for cast device 23:1:52495c7b-c08a-5360-131f-0f20d825b541
03/25 08:09:48 Trace: [dspengine] created new dsp config {"version":3,"items":[{"type":"bs2b","enabled":false},{"type":"parametric_equalizer","enabled":false},{"type":"audeze_presets","enabled":false}]}
03/25 08:09:48 Trace: [transport/audeze] picking preset lowlatency 
03/25 08:09:48 Trace: [transport/audeze] picked null preset!
03/25 08:09:48 Trace: [zone Bifrost 2] Loading
03/25 08:09:48 Trace: [zone Bifrost 2] Suspend
03/25 08:09:48 Info: [zone Bifrost 2] Canceling Pending Sleep
03/25 08:09:48 Info: [transport] created zone Bifrost 2
03/25 08:09:48 Info: [transport]     with endpoint Chromecast Audio (23:1:52495c7b-c08a-5360-131f-0f20d825b541) [IsAvailable=True]
03/25 08:09:48 Trace: [Bifrost 2] [Lossless, 24/48 MQA TIDAL FLAC => 24/96 MQA] [100% buf] [STOPPED @ 0:00] 
03/25 08:09:48 Info: [transport/zonedisplay] Zone display registered: Lenovo Smart Display 10
03/25 08:09:48 Trace: [zone Bifrost 2] Loaded Queue=903 Tracks Swim=Inactive AutoSwim=True Loop=Disabled Shuffle=False
03/25 08:09:48 Trace: [Bifrost 2] [Lossless, 24/48 MQA TIDAL FLAC => 24/96 MQA] [100% buf] [PAUSED @ 2:48/3:13] The Long Way Home - Norah Jones / Kathleen Brennan / Tom Waits
03/25 08:09:48 Trace: [dbperf] flush 0 bytes, 0 ops in 1 ms (cumulative 0 bytes, 0 ops in 15621 ms)
03/25 08:09:48 Debug: GET /image/hfveaaaa.512.jpg
03/25 08:09:48 Trace: GetImageData[Remote](id=84637 spec=512 key=hfveaaaa) => got from cache overalltime=4ms
03/25 08:09:48 Trace: GetImageData[Remote](id=84637 spec=512 key=hfveaaaa) => got from cache overalltime=6ms
03/25 08:09:48 Info: [transport/zonedisplay] Zone display registered: Google Nest Hub Max
03/25 08:09:48 Trace: [dbperf] flush 0 bytes, 0 ops in 38 ms (cumulative 0 bytes, 0 ops in 15659 ms)
03/25 08:09:48 Debug: [easyhttp] [255] GET to https://metadata.roonlabs.net/1/tracks/168:0:77631960/lyrics returned after 338 ms, status code: 304
03/25 08:09:48 Debug: [easyhttp] [258] GET to https://metadata.roonlabs.net/1/albums/166:0:77631949/credits?c=tidal-us returned after 237 ms, status code: 304
03/25 08:09:48 Debug: [easyhttp] [266] GET to https://metadata.roonlabs.net/1/works/174:1:f75adc23-5a3a-348f-8031-8df37ea09741/descriptions?c=tidal-us returned after 237 ms, status code: 304
03/25 08:09:48 Debug: [easyhttp] [263] POST to https://metadata.roonlabs.net/1/performers/translate?c=tidal-us returned after 241 ms, status code: 200
03/25 08:09:48 Debug: [easyhttp] [256] GET to https://metadata.roonlabs.net/1/albums/166:0:77631949?c=tidal-us returned after 275 ms, status code: 304
03/25 08:09:48 Debug: [easyhttp] [264] GET to https://metadata.roonlabs.net/1/works/174:1:f75adc23-5a3a-348f-8031-8df37ea09741?c=tidal-us returned after 262 ms, status code: 304
03/25 08:09:48 Debug: [easyhttp] [265] GET to https://metadata.roonlabs.net/1/works/174:1:f75adc23-5a3a-348f-8031-8df37ea09741/parts?c=tidal-us returned after 261 ms, status code: 304
03/25 08:09:48 Debug: [easyhttp] [257] GET to https://metadata.roonlabs.net/1/albums/166:0:77631949/tracks?c=tidal-us returned after 273 ms, status code: 304
03/25 08:09:48 Debug: [easyhttp] [260] POST to https://metadata.roonlabs.net/1/albums/translate?c=tidal-us returned after 268 ms, status code: 200
03/25 08:09:48 Debug: [easyhttp] [259] GET to https://metadata.roonlabs.net/1/albums/166:0:77631949/reviews?c=tidal-us returned after 269 ms, status code: 304
03/25 08:09:48 Info: [metadata/albumdetails] Created album details screen for a6003737363331393439
03/25 08:09:48 Info: [metadata/albumdetails] 79004d5730303030333332333832,79004d5230303033363431343733,79004d5230303033373839373237,79004d5230303033313034343535,79004d5230303031313130333838,79004d5230303031303933393537,79004d5230303031303432343431,79004d5230303030383431363239,79004d5230303030373135333732,79004d5230303030343637303430,79004d5230303030323431343038,79004d5230303031313039383637,79004d5230303035303831353433,79004d5230303031313130353437,79004d5230303031313039343239,79004d5230303030393032333134,79004d5230303031313038353730,79004d5230303035363039303138,79004d5230303035323436393030,79004d5230303034363033353637,79004d5230303033323132383035,79004d5230303031303931313537,79004d5230303031303930353636,3e015e8443d46afddd43a5337ac239809cb6,3e019c55c3e59426514abace0285b07d2f76,3e01c8ce6abdcf943d3da71411632b562ac6,3e01fd864e63b3c67c35b667f9087bcf5b6f,3e01c8b52025eca6a6359504473f171c8838,3e01f7b55f17a2bbb33fb8936d510ff1a70e,3e015b00cf3619c2434ca027b4ca3ebf67ce,3e013ccecc0519c1f549b711121db77c0999,3e010f12174d698bf84db8b6558abb735986,3e01975fc86a6d995747a00ece84b3af94e0,3e017363dc268cdddc39a10728abcdcfb8af,3e01a54868004659db3f96a0fb5ad179d60f,3e017773c9cbf3051140a8fa0aaa1ca9ffd1,3e0168fe1e8a81c1674e9de750199f629e18,3e0105e30239cbe49a45807a301a968ee33b,3e010631411c23d67b43bb581783d611b169,3e0187e194122056684cb94b623416addde6,3e013beee2024f35c14a83186752e91d3856,3e015573276ff5230e42af04bf3bcba463e6,3e01b5be370938e6c53ab2d7274165e0e75a,3e01872f8ea258fa5245a38336ca9ed88145,a600313536323239,a6003737363331393439,a6003737363130383537,a600313132373037303135,a600313131323133303739,c80030373234333538343830303534,c8007838626534756f7132397a6861,c80030303630323533373533303139,c80030303630323533373533303231,c80065797234796e73716862627561,d20034393734333638,d200363237343430383332,d200363232373238343435,d200333834353937353131
03/25 08:09:48 Debug: [easyhttp] [262] POST to https://metadata.roonlabs.net/1/albums/translate?c=tidal-us returned after 297 ms, status code: 200
03/25 08:09:48 Debug: [easyhttp] [261] POST to https://metadata.roonlabs.net/1/performers/translate?c=tidal-us returned after 297 ms, status code: 200
03/25 08:09:49 Debug: GET /image/hfveaaaa.1024.jpg
03/25 08:09:49 Trace: GetImageData[Remote](id=84637 spec=1024 key=hfveaaaa) => got from cache overalltime=0ms
03/25 08:09:49 Trace: GetImageData[Remote](id=84637 spec=1024 key=hfveaaaa) => got from cache overalltime=1ms
03/25 08:09:49 Debug: GET /image/izqbaaaa.1by1_512.jpg
03/25 08:09:49 Debug: GET /image/jzqbaaaa.1by1_2048.jpg
03/25 08:09:49 Trace: GetImageData[Remote](id=29050 spec=1by1_512 key=izqbaaaa) => got from cache overalltime=1ms
03/25 08:09:49 Trace: GetImageData[Remote](id=29050 spec=1by1_512 key=izqbaaaa) => got from cache overalltime=1ms
03/25 08:09:49 Trace: GetImageData[Remote](id=29051 spec=1by1_2048 key=jzqbaaaa) => got from cache overalltime=1ms
03/25 08:09:49 Trace: GetImageData[Remote](id=29051 spec=1by1_2048 key=jzqbaaaa) => got from cache overalltime=4ms
03/25 08:09:49 Debug: GET /image/izqbaaaa.1by1_512.jpg
03/25 08:09:49 Trace: GetImageData[Remote](id=29050 spec=1by1_512 key=izqbaaaa) => got from cache overalltime=0ms
03/25 08:09:49 Trace: GetImageData[Remote](id=29050 spec=1by1_512 key=izqbaaaa) => got from cache overalltime=0ms
03/25 08:09:49 Debug: [easyhttp] [267] POST to https://metadata.roonlabs.net/1/albums/translate?c=tidal-us returned after 269 ms, status code: 200
03/25 08:09:49 Debug: [easyhttp] [268] POST to https://metadata.roonlabs.net/1/albums/translate?c=tidal-us returned after 270 ms, status code: 200
03/25 08:09:49 Info: [library/albumdetails] found 5 streaming service alternates
03/25 08:09:49 Debug: [easyhttp] [269] POST to https://browse.roonlabs.net/1/works/trackCounts?c=tidal-us returned after 237 ms, status code: 200
03/25 08:09:49 Debug: [easyhttp] [253] GET to https://discover.roonlabs.net/1/albums/121:0:MW0000332382/albums/morefromgenre?profileId=4e526b78-4feb-459e-bb12-d95a1f9cc95b&c=tidal-us returned after 2899 ms, status code: 200
03/25 08:09:49 Trace: [dbperf] flush 0 bytes, 0 ops in 5 ms (cumulative 0 bytes, 0 ops in 15664 ms)
03/25 08:09:50 Debug: GET /image/jfveaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/lpveaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/ipveaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/spveaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/opveaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/pqffaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/txteaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/juteaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/fnefaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/whafaaaa.512.jpg
03/25 08:09:50 Debug: GET /image/epveaaaa.512.jpg
03/25 08:09:50 Trace: GetImageData[Remote](id=84639 spec=512 key=jfveaaaa) => got from cache overalltime=5ms
03/25 08:09:50 Trace: GetImageData[Remote](id=83677 spec=512 key=juteaaaa) => got from cache overalltime=3ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84894 spec=512 key=epveaaaa) => got from cache overalltime=5ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84639 spec=512 key=jfveaaaa) => got from cache overalltime=8ms
03/25 08:09:50 Trace: GetImageData[Remote](id=83677 spec=512 key=juteaaaa) => got from cache overalltime=5ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84894 spec=512 key=epveaaaa) => got from cache overalltime=6ms
03/25 08:09:50 Trace: GetImageData[Remote](id=88084 spec=512 key=whafaaaa) => got from cache overalltime=4ms
03/25 08:09:50 Trace: GetImageData[Remote](id=91691 spec=512 key=pqffaaaa) => got from cache overalltime=5ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84898 spec=512 key=ipveaaaa) => got from cache overalltime=7ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84904 spec=512 key=opveaaaa) => got from cache overalltime=5ms
03/25 08:09:50 Trace: GetImageData[Remote](id=88084 spec=512 key=whafaaaa) => got from cache overalltime=7ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84898 spec=512 key=ipveaaaa) => got from cache overalltime=10ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84904 spec=512 key=opveaaaa) => got from cache overalltime=8ms
03/25 08:09:50 Trace: GetImageData[Remote](id=83765 spec=512 key=txteaaaa) => got from cache overalltime=6ms
03/25 08:09:50 Trace: GetImageData[Remote](id=91691 spec=512 key=pqffaaaa) => got from cache overalltime=8ms
03/25 08:09:50 Trace: GetImageData[Remote](id=83765 spec=512 key=txteaaaa) => got from cache overalltime=7ms
03/25 08:09:50 Trace: GetImageData[Remote](id=90927 spec=512 key=fnefaaaa) => got from cache overalltime=9ms
03/25 08:09:50 Trace: GetImageData[Remote](id=90927 spec=512 key=fnefaaaa) => got from cache overalltime=9ms
03/25 08:09:50 Trace: GetImageData[Remote](id=84901 spec=512 key=lpveaaaa uri=https://imagecache.roonlabs.net/im/1/albums/a6003737363131343230/cover/512.jpg) => fetched in 121ms status=200 size=94006 overalltime=153ms
03/25 08:09:50 Debug: [easyhttp] [270] GET to https://metadata.roonlabs.net/1/tracks/168:0:77631960/lyrics returned after 816 ms, status code: 304
03/25 08:09:50 Trace: GetImageData[Remote](id=84908 spec=512 key=spveaaaa uri=https://imagecache.roonlabs.net/im/1/albums/a6003933303538373634/cover/512.jpg) => fetched in 241ms status=304 size=0 overalltime=250ms
03/25 08:09:52 Info: [brokerserver] Client disconnected: 192.168.1.54:49156
03/25 08:09:52 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] lost client connection. Retrying
03/25 08:09:52 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] connecting (attempt 1)
03/25 08:09:52 Warn: [rnet/RnetJsonClient] failed to connect Connection refused
03/25 08:09:52 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] client connection failed. Retrying in 500ms
03/25 08:09:53 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] connecting (attempt 2)
03/25 08:09:53 Warn: [rnet/RnetJsonClient] failed to connect Connection refused
03/25 08:09:53 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] client connection failed. Retrying in 750ms
03/25 08:09:53 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] connecting (attempt 3)
03/25 08:09:53 Warn: [rnet/RnetJsonClient] failed to connect Connection refused
03/25 08:09:53 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] client connection failed. Retrying in 1125ms
03/25 08:09:55 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] connecting (attempt 4)
03/25 08:09:55 Warn: [rnet/RnetJsonClient] failed to connect Connection refused
03/25 08:09:55 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] client connection failed. Retrying in 1687ms
03/25 08:09:56 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] connecting (attempt 5)
03/25 08:09:56 Warn: [rnet/RnetJsonClient] failed to connect Connection refused
03/25 08:09:56 Trace: [raatserver] [RaatServer Pixel 5 @ 192.168.1.54:9200] client connection failed. Giving up
03/25 08:09:56 Trace: [raat] [sood] Refreshing device list
03/25 08:10:00 Info: [stats] 26694mb Virtual, 5167mb Physical, 3532mb Managed, 320 Handles, 92 Threads
03/25 08:10:07 Debug: [easyhttp] [274] POST to https://device-map.roonlabs.net/1/register returned after 347 ms, status code: 200
03/25 08:10:07 Trace: [devicemap] device map updated
03/25 08:10:09 Info: [transport] destroyed zone Bifrost 2 was playing? False
03/25 08:10:09 Trace: [zone Bifrost 2] Suspend
03/25 08:10:09 Info: [zone Bifrost 2] Canceling Pending Sleep
03/25 08:10:09 Info: [zone Bifrost 2] Canceling Pending Sleep
03/25 08:10:11 Info: [cast] lost device Chromecast Audio because it disconnected
03/25 08:10:15 Info: [stats] 26565mb Virtual, 7522mb Physical, 6372mb Managed, 315 Handles, 74 Threads
03/25 08:10:16 Debug: [easyhttp] [275] POST to https://discovery.roonlabs.net/1/query returned after 286 ms, status code: 200
03/25 08:10:30 Info: [stats] 26565mb Virtual, 7524mb Physical, 6405mb Managed, 315 Handles, 75 Threads
03/25 08:10:43 Trace: [broker/accounts] [heartbeat] now=3/25/2022 12:10:43 PM nextauthrefresh=3/25/2022 1:05:45 PM nextmachineallocate=3/25/2022 4:05:43 PM
03/25 08:10:45 Info: [stats] 26565mb Virtual, 7527mb Physical, 6432mb Managed, 314 Handles, 75 Threads

Following up. A thousand thanks goes to Rugby (Daniel Beyer). It appears that his suggestion resolved the issues with my vanilla roon server installation (via easy install script). After removing the orbit folder, memory utilization has returned to a more normal state, and the crashing has stopped (for more than 10 tracks now! yippee!!!)

Here is memory over the last day. The cliff is when I applied the orbit fix.

Recommendation for @support , acknowledging your subscribers and setting my expectation will greatly increase satisfaction and temper frustration…

Thanks again Rugby!
Josh

1 Like

Hey @Josh_Davis,

We cannot thank you enough for letting us know of the issue you’re experiencing, for being this detailed in sharing exactly what was going on and, it turns out, for engaging with our community to find a solution (especially over the weekend when the Support team isn’t around). I cannot say I am surprised that @Rugby was the one who helped, but, our gratitude towards him is increasing day by day. Thank you, @Rugby for being this invested to help out and sorting things out with @Josh_Davis.

The solution that worked for you is actually a workaround while our team finishes up a permanent fix.

Please, bear with us until the next release :nerd_face: