· Other
· I'm having trouble adding music to my library
· Other
Roon only finding 1/2 the tracks it did a few days ago
Hardwired 2.5Gb / 1Gb unmanaged network
I use itunes on mac to rip CDs etc to a file system that is SMB shared to Roon.
Normally things work fine - roon sees the “iTunes” mount and indexes the 120,000 tracks there.
Itunes still sees that number of tracks, and the file system shows that number of tracks.
But as of yesterday roon only sees 61,000 tracks there.
Roon ROCK is running on a mini intel server.
Rebooted my Mac, rebooted the ROCK, told Roon to reindex the dir, disabled and reenabled the storage location, but none of that has fixed the problem.
Thanks.
Hi @Peter_Galvin1,
Thanks for your post.
It sounds like Roon is possibly unable to traverse the full storage location ``\PGBMacStudio.local\iTunes` because of a read permissions issue on a particular subfolder. Is there a pattern to which iTunes content is missing? If you notice an entire subfolder is missing, ensure that read permissions haven’t changed.
What do you see in Settings → Library → Skipped Files?
You mentioned these missing iTunes track files are still visible in a file viewer - what happens if you attempt to drag-and-drop one into Roon, or move it to the mch location that is also targeted as a Watched Folder per your screenshot?
We’ll watch for your response. Thank you!
Hi Connor.
Skipped files has a few dozen (corrupt), so no clue there.
Dragging a missing track from the file browser to roon adds it to roon.
Checking around the iTunes dir tree, all files seem to be owned my me so shouldn’t be a permissions problem.
Hi @Peter_Galvin1,
Can you confirm the proper share settings are applied to each folder nested within your iTunes directory? Here is more information on this:
Are you able to take a closer look into @connors below question:
For example, are you only seeing your ‘Various Artists’ not showing up, etc?
Hmm, I just have 2 shares from that Mac, and at least some tracks are being found from each. Nothing nested.
Right, I had “Various Artists” disappear before, and when I touched a file in it it reappeared in Roon. No such luck this time - Various artist albums are there. No obvious pattern about what is missing. I sorted albums by artist and A through Z are covered. Likewise title…
Hello @Peter_Galvin1
Thank you for the update.
By any chance, do you have the Backup before the albums have disappeared for you? Can you try restoring from the backup and see how it goes after that?
Y’all suspected a corrupt database a few weeks ago so I did a complete rebuild.
I could do it again, with the annoyance of having to manual record and restore all my settings.
But why is it my database keeps having problems?
Short of reinstalling, I removed the storage item from roon and readded it. Still found the same number of tracks.
Hello @Peter_Galvin1
From what you are describing, it may be the latent corruption of the internal database.
There are a number of reasons why a Roon database can become corrupted, and this can include failing hard drives, as well as other environmental factors, like power loss, or sync programs tampering with the contents of the database.
It’s extremely hard to know what might be at play here, but what is certain is that when Roon reads the database back, the files are different from what was originally written to the drive, and the changes are significant enough that Roon cannot load the database properly.
There are times when the corruption can be “latent”: part of the database is corrupted, but the database can still load. Often, this latent corruption is revealed when Roon updates to a new database format, as this process requires that every record in the database is accessed.
This is likely the case here — The backup that you used to restore was made after the latent corruption existed.
Generally, the solution is to try using an even older backup if you have one in order to use a backup from before the corruption occurred. Otherwise, starting fresh is the second option.
What database is Roon using? My company’s product uses PostGres and NEVER has database corruption. Databases should not corrupt. That is a design goal of a database.
On the ROCK via file browsing I stopped roon, moved the Database directory out of the way, restarted roon and added back the file shares. It again stops at 1/2 of my tracks on ftunes/itunes
Hi @Peter_Galvin1,
Can you provide more details around the actual machine hosting your local library?
We’re seeing some error traces around an external drive that could be related to your issues, for example:
(none) user.notice storage/automount.sh: mount: mounting /dev/sda1 on /roon/sys/storage/mounts/Micron_CT4000X10PROSSD9_2428E8CEB434-p1 failed: Invalid argument
(none) user.err kernel: [ 2.518658] exFAT-fs (sda1): invalid boot record signature
(none) user.err kernel: [ 2.518660] exFAT-fs (sda1): failed to read boot sector
(none) user.err kernel: [ 2.518661] exFAT-fs (sda1): failed to recognize exfat typeIt may be worth testing the devices for any hardware/drive failures - it’s clear that Roon is having a tough time mounting the drive. If you can, I’d also test out using a different cable if possible.
With that, we do see clumps of corrupt tracks popping up during library scanning - but not a ton, for example, this album:
Info: Attach skipped file SkippedFile[5878b2d2-8d4e-49d0-8790-c00676fbfd6b::Music/Jimmy Buffett/FruitcakesI don’t think it’s causing the issues you’re seeing, but worth noting nonetheless. You can use third-party apps to repair corrupt files, which may help you here.
Hi Benjamin,
I have an Asus NUC 12 pro as the server running ROCK.
And attached a Crucial x10 pro SSD to hold my DSD/DSF files - my guess is that is what is causing those exfat errors. It’s not a boot drive so not sure they matter?
But I can copy all the music off, reformat it, and copy the music back.
But that’s not the music that Roon is having trouble with. Rather it’s on an external array attached to my Mac, written to by iTunes, and SMB shared to the ROCK. It’s worked pretty well for the past couple of years except the Roon database gets corrupt every couple of years it seems, and now this new problem of Roon only finding some of the music on it.