Excessive Memory Usage and Performance Slowdown in Roon Server (ref#0BVMRS)

11 more crashes.
Three today, two yesterday, six the day before that.

Most happen quietly in the background and go unnoticed. I suspect this is happening to quite a few other people too. My Windows logs show this has been happening since well into last year.

Today it crashed twice whilst I was playing music in my workshop. It was all streaming just fine for a couple of hours… but then at 12:52:01 it just stopped. A look at the UI on my Android phone showed that it was waiting for the server.

The RoonApplince.exe on my server had crashed. It automatically re-launched and after about 30 seconds the roon UI on my phone started working again. I then had to hit the play button again but music picked pup right where it had left off. After that I ignored what had just happened and went back to workshop activities.

The same thing then happened again EXACTLY 15 minutes later at 13:07:01

It seems to me that it happens more often when playing from that Workshop zone (HFB1) than from others but I cannot say for sure.

I have just stopped the server and uploaded another set of logs. All eleven crashes should be visible. The timings of these crash events are very suspicious. See screenshot below

Just what is ROON (or something else?) doing every 15 minutes?

This is looking very similar to my issues elsewhere on support.

Number of crashes every day is a bit variable but it does seem to always happen at multiples of 15 minutes. Sometimes every 15 minutes… though I only saw that often once and then I re-installed everything and then it went back to happening less often.

It happens so often that I cannot tell whether the excessive memory use problem has gone away because Roon constantly relaunches itself.

It happens less often on a much more powerful server, but it still happens.
Back to the slower server (after checking memory and boot drive) and it is definitely back to happening more often.

C’mon Roon, multiple people seeing “random” (but not very) stack overflow crashes and we hear nothing but tumbleweed (and Jellyfish).

I cannot imagine tolerating this from any other appliance (lighting, cars, internet browser, cooker, CD player). Even public transport is more reliable.

Please please please fix it. It is driving me nuts.

And again… at 17:07:01
Nothing was playing on any zone.

Hi @Andrew_Beveridge,

There’s an open ticket with development. In the meantime, please take the following steps for us to compare logging:

  1. Remove the BossDAC Zone completely
  2. Disable Tidal in Settings → Services

Reproduce the issue - our team will activate additional logging for RoonServer in the meantime.

Thanks!

That will be removing all my Raat zones (three zones). Those are all Ropieee with Allo DACs.The one I use the most (main listening Zone) is in my lounge and is wired. Two others nearby are only very rarely used but are on WiFi.

Removing all those will just leave my workshop (another Ropieee, but different DAC). Do you want me to remove that too?

After that there is only an AudioPro C10… an Airplay speaker.

I’ll do it but you need to realise that will leave Roon pretty unusable here.

OK, as of 8:08am today I have no just one remote zone (C10 airplay), and one local zone (this desktop PC). And no streaming services (I assume you did not intend for me to re-enable Qobuz so that is still disabled, along with Tidal).
Nothing playing. Server restarted.

1 Like

Hi @Andrew_Beveridge,

That’s all we needed; this was purely a diagnostic test to inform development. We’ll respond shortly with next steps.

If you’re willing to share the most recent crash report for RoonAppliance from Event Viewer, you can upload it securely here. This will greatly expedite our investigation.

Sure, I just uploaded logs and event viewer screenshot.
This has the three crashes that happened today (at 00:07:02 and 03:07:03 and 04:22:03)
as well as the ten that happened yesterday (though I already uploaded those before anyway).

I have not seen any more since breakfast today, but my Ropieee raat zones are all disabled and streaming is disabled too so that may be something to do with it. I will leave all that disabled for now and overnight just to see if the problems really have stopped with those off.

Sounds good, thanks for sending those over @Andrew_Beveridge :+1:

And RoonAppliance.exe is STILL crashing.
Maybe not so often but one crash on 26th and two more this morning (27th).

This is despite ALL Roon Raat endpoint zones being removed (disabled in Roon/Settings/Audio), leaving only a single airplay zone and a wired PC.
And with Tidal and Qobuz both disabled and analysis disabled as requested.

I will upload an archive with event screenshot.

You will notice that the crashes are still at multiples of pretty precisely 15 minutes.
Always at 07 or 22 or 37 or 52 minutes past the hour.

Hi @Andrew_Beveridge ,

Thanks for the update. We are still actively looking into your case and we just had a meeting with a dev to try to get to the bottom of it, but unfortunately, the RoonServer logs are not very helpful in pinpointing the issue, I think we will need to change tactics soon and look into some more advanced troubleshooting option. Before we look into the advanced option, can you please confirm there are no issues with your operating system, just to rule this out?

  1. To open the Command Prompt as an administrator in Windows, type “cmd” in the search bar and then right-click on the Command Prompt result and select “Run as administrator” as shown in the image below.
    Run CMD As Administrator
  2. To run a DISM scan, type the following command and press Enter: dism /online /cleanup-image /restorehealth Windows 11 DISM
    This will check your Windows component store for corruption and automatically fix any problems it finds. This process may take several minutes or longer depending on your system
  3. To run an SFC scan, type in the Command Prompt the following command and press Enter:sfc /scannow

sfc /scannow

This will scan all protected system files and replace any corrupted or missing ones with a cached copy. Wait for the scan to complete. It may take some time depending on your system configuration.
4. After both scans are completed, you should restart your computer to apply any changes. Check to see if the issue is solved.

I did all that yesterday evening.
dism, sfc, then reboot.

It still crashed again this morning at 07:21:58

Note the 15 minute thing again as always… at almost exactly 22 minutes past the hour like many of the other crashes.

My NUC is normally backed-up by a Windows Server every day however some time ago I disabled that after I read of Roon’s problems with Apple’s Time Machine.
For a while I ran with backup disabled for just the Roon app folders but after that did not seem to make any difference I tried removing this PC from the backup roster altogether to keep Windows shadow copy service from interfering… that made no difference either.

But FYI backups are still disabled for this PC; And I do not run automatic Roon database backups.

Andrew it will be interesting if they can tell you what was running aand why it is running so often.
I like that Plex Server allows you to set a timer window for metadata updates

1 Like

Just a quick note that you’re not alone. I have seen these issues on multiple machines. They are independent of user activity. Roon crashes itself on Ubuntu too…

1 Like

Roon Server is still crashing.
NINE times yesterday.
FIVE today (so far).

When it works it is still great. But the crashes spoil the whole experience massively.

I have not uploaded logs for these. I have already uploaded so many logs.
They do not seem to be helping anything.

LMS is working fine here now.
It is not as good-looking as Roon but at least it works. And it has Tidal support.
Just a trade of what Roon does vs how annoying it is to use against an alternative.

I don’t want to turn Roon off but I don’t think I can properly compare the experience of using if I am trying to keep Roon alive at the same time… the annoyance is hard to look past. I might need to leave Roon powered off for a few weeks.

I’ve been having all kinds of problems with Roon lately. Crashing, sluggish response, messages about corrupt DB (reboot and it would work). Disabled Tidal and have had zero problems the last 3 days. Stable, snappy. Everything populating instantly. Not really a solution though as I use Tidal a lot.

I get the impression it is not related to anything specifically that I do.

It crashes more often if I have zones on slower WiFi but still happens if I eliminate those.

It crashes more often if I have Qobuz enabled. But it still happens if I do not.

With Qobuz disabled, it crashes more often if I have Tidal enabled but still happens if I do not.

With Tidal and Qobuz disabled it crashes more often if I play things, but still happens if left alone with nothing playing.

It crashes much less often on a vastly more powerful server (16 core, 32GB RAM, 4.4GHz) but it still happens.

It seems like just being busy somewhere is what makes it more likely to crash… regardless of whether that is with services or network comms, or metadata update, or analysis.

By now Roon developers should have been able to identify the thread which is responsible for the stack overflow, if it is a consistent thread? And if so, what aspects of Roon are running in that thread. It should not take several months to track&trace this.

2 Likes

OK, in the last couple of days Roon Server (RoonAppliance.exe) has crashed a few times during playback.
When this happens it automatically restarts so after 30 seconds or so you are back where you were and Ron continues to work “normally” for a while.

I don’t know if this helps but I have noticed that sometimes when it does this the image cache has been screwed up. For example…

Clearing the image cache sorts this out. I just wondered if the information that these crashes break the image cache might be helpful.

Hi @Andrew_Beveridge ,

Thanks for giving the health checks a try. Let’s proceed with the more advanced debugging option, I have sent you this info in a private message so that I can loop in the dev team as needed, should they have any follow-up questions about the test results.

For anyone else that is following this… I have followed instructions provided and have just uploaded a detailed (well, 700MB) .NET trace for Roon to take a look at.

Fingers crossed this leads to something useful.

2 Likes