Custom PC, Threadripper 3970X 64-thread CPU, 64GB memory, Optane 905P Roon/database drive, 4x2TB RAID 0 SSD music folder, Windows 10 Pro x64 20H2, Roon 1.7 Build 170
Roon, database and music all on the same PC. True 1Gbps symmetrical fiber internet, local 10Gbps network. Internet speedtests consistently at ~900 down, ~700 up
Multiple hard-wired ethernet (no wi-fi) devices, primarily Mytek Manhattan II and Kef LS50 (USB to my PC).
Very slow creation of database
Hi there,
I did a major revamp of my music files, adding a lot of metadata (using Jaikoz), and decided to recreate my Roon database. Bad move.
My usual Roon server is a NUC i7, 8GB memory, Samsung NVMe 250GB primary drive, internal Samsung 4TB SSD, external USB 3.0 2TB SSD. It’s run well for three years. When I deleted the database and added the internal music folder, about 3.2TB, 130,000 FLAC tracks, the NUC added and identified the first 30,000 or so tracks quickly i.e. 2-3 per second. Then it progressively slowed down so that, at 50,000 tracks, it was doing 1-2 tracks per minute. It would take a month to finish.
I thought that it would be quicker to create the database on my custom PC, back up the database and then restore it on the NUC. The music files are mirrored on my PC and the NUC.
The PC is a very fast device, with a meaty processor, and the primary drive is an Intel Optane 905P, which is optimized for small non-sequential reads and writes. Although sequential rates are “only” 2GB/s or so, small random reads and writes are 2-3x faster than other, non-enterprise, SSDs. The music files are on 4x2TB SSD RAID 0 array, with very fast reads.
I started the database creation on the PC, pointed it at a local music folder of 130,000 tracks, 3.2TB, and the same issue is happening right now on the PC as on the NUC. It went very fast at first, but now, at about 65,000 tracks processed, it’s adding new ones to the database at about 10 per minute. Roon is only exercising one or two threads, disk activity on the Optane (Roon, datatabase) is less than 1%, 100kB/s or so. Disk activity on the music folder is negligible except for a quick 7-8MB/s spike once or twice a minute (when, I guess, Roon reads a new track), and internet access is also negligible. So, while Roon is pounding one thread (70-90%) most of the time, not much else is happening.
I’m wondering if the 1-2 threaded database adds are the factor slowing all of this down, or, maybe, Roon metadata lookups are throttled after a time? At this rate, assuming no more slowdowns, I’ve got 5-6 more days to go to build this database, and that’s before I add my other, 1TB, music folder. Your thoughts welcomed. Thanks!