Nucleus crashing and unable to restore from backup

Hello @Dave_Murphy

We sincerely apologize, but our QA team has identified a latent corruption in your database. Unfortunately, at this time, there is nothing we can do to repair it. To continue using Roon, you will need to start a new database.

We have, however, escalated this issue to our R&D team so that they can work on preventing such corruptions in the future.

We truly regret the inconvenience and appreciate your understanding.

Ok, I am assuming what you mean is that there is a corrupt file in my music collection, but you’re not able to identify which file it is. So I need to delete all of the music files from the nucleus, and then reload everything back onto the nucleus. (Hoping that I will discover any problematic files in the process so I can leave them out or fix them.)

Is that correct? If so, can you please give me the best steps and recommendations for the process of doing that. Thanks

No, the corruption found is within the Roon database (what is used by the Roon application to index and manage your music collection).

No, the music file can be left in place on the SSD, it’s just the DB that needs resetting.

You can reset the Roon Database via the Nucleus’ WebUI see below…

Once reset you will have to login in again and then setup Roon from scratch, it will then re-import and index your existing music files.

Thanks for the clarification. I have stopped the Roon Server Software, changed the server file name, and then restarted the server many times. I thought that process was “rebuilding the database”. I see that there is the option on the web interface right next to it that specifically says “Reset” Roon Database & Settings. What I am understanding you to be saying is that I need to use that Reset Button. Do I need to do any of the steps I did before with the Roon Server like changing file names or stopping it?

Also after I do this process does that mean I should not ever restore from any of my old backup files? Would that potentially reintroduce a corruption that we are trying to get away from?

Thanks

The system crashed again yesterday, if you could please advise if I should do any of the process involving the roon server file before I reset the database. I will have some time in the morning tomorrow to work on this so any response would be appreciated. Thanks.

Good day @Dave_Murphy !

Yes, you got it correctly, you have to reinstall Roon Software without restoring any backups, no need to delete your music .

In order to do that you have to press “Reset” button under “Roon Database & settings”. After that please set up the Roon installation from scratch.

Or you can do it via alternative way:

  • Stop RoonServer from running in ROCK’s WebUI
  • Navigate to your ROCK’s Database Location
  • Find the folder that says “RoonServer”
  • Rename the “RoonServer” folder to “RoonServer_old”
  • Restart the RoonServer in the WebUI to generate a new Roon database folder
  • On the Roon Remotes, press “Use another Roon Server” and connect to the new database

Regards.

I am not at home with the system until tomorrow so I am not able to try anything right now but before I left last week I did the steps for resetting the system (press “Reset” button under “Roon Database & settings"). Then I restarted Roon and the database started to rebuild itself. Then it stopped and told me I needed to restore it from a backup becuase it was having trouble loading my library again. I restored from one of the backups and it was working again but did that probably reintroduce some corruption into the system?

Hello @Dave_Murphy ,

Thanks for letting us know what happened. I was able to look over your Nucleus diagnostics and it doesn’t look like there were any further corruption traces after you performed the restore. Do let us know how the system performs moving forward and if you experience any further issues, thanks!

Could you please check the logs for Sept 4 between 7 and 8 pm. We had been out of town and just got back and when I tried to open up Roon it was unable to find the server. I used the Web interface to reboot it but after I rebooted it, it never came back online. I ended up physically unplugging it for a minute and then I plugged it back in and it came online. It looked like everything was working correctly again. Then I played two songs and on the second song it crashed and said it was having trouble loading my library and I needed to restore from a backup. I used the Web interface to reboot it again and now it seems to be working again. Can you see anything in the logs?

It just crashed again at 7:59 PM.

I restored it from the August 31 back up and immediately after I relaunched the system it said I needed to restore from a backup again. Then I restored it from the August 30 back up and after I relaunched it, it seemed to load up again. Then before I had chance to play any music it crashed again around 8:38PM.

Hey @Dave_Murphy,

Thanks for your ongoing patience here! We did see fresh traces of database corruption upon another look:

Warn: [broker] validation failed: LevelDb.Exception: Corruption: corrupted compressed block contents 

You mention you’re seeing this when you first open Roon on a fresh database, and are in the process of importing your library for the first time?

If you look back to one of my earlier posts in this thread I did a screen capture video of what happens and when. Thanks.

Hello @Dave_Murphy,

Let me rephrase the question from @benjamin

Are you still running Roon with the old database, or have you already reinstalled the software and reset the database via the WebUI?

If the corruption also appears when using a clean, freshly reset database, this strongly suggests that the issue may be caused by a failing system drive.

I had already reinstalled the software and reset the database.

I had been out of town and just got back. The Nucleus was visible on the network but it said it was unable to access the library. I reinstalled the operating system, then I stopped the RoonServer, renamed the RoonServer Folder and started the RoonServer again. Then I reset the Roon Database and Settings.

After it said that the reset was complete I opened Roon Remote and it started to reindex all of my music files. After about 2 minutes it stopped and indicated there was a problem loading my library and I needed to restore from a backup. I restored from a September 5th back up. It should back up every day but the last backup available was from Sept. 7th so whatever happened this time happened sometime after 4AM on Spetember 7th.

Currently things are working after I restored from the backup but this seems to be the same hamster wheel I have been on for a while. Do you have any other thoughts or suggestions?

Thanks

Hello @Dave_Murphy,

From the latest diagnostic data, I don’t see any errors related to database corruption. Could you kindly let us know how things are running on your end now?

I am out of town, but it looked like things worked well for a day and a half when I was in town, and I’m able to access Arc currently so it looks like things are still operating correctly.

Hello @Dave_Murphy ,

Thank you for the update! Please let us know how the system is performing when you return back in town and if there are any remaining issues.

Things seemed to have been working fine this week but sometime between 12:00 and 8:00 this morning it crashed again. I got a message saying it was unable to load and I needed to restre from a backup but I rebooted the nucleus and it came back online. It should have backed up at 4 AM and that backup did not happen so I am wondering if something happened during the backup or if it crashed before then. Can you tell from the logs?