Roon failed to import new albums and number of tracks / albums keep decreasing after restart

Roon Core Machine

Windows 10 20H2 build 19042.1165
Intel(R) Core™ i7-2600 CPU @ 3.40GHz 3.40 GHz
24 GB RAM

Networking Gear & Setup Details

Asus AC88, on Ethernet connection

Connected Audio Devices

Hugo 2 via USB

Number of Tracks in Library

67000+ tracks

Description of Issue

Just happened today when I try to add new albums to the Network drive, the new albums do not show in Roon. The summary on Home page keep decreasing and drop to 8500 tracks.

Tried to rescanned the library but no luck. Found the log keeps complaining on this exception:

09/01 23:59:36 Info: [updatemetadata] advancing metadata timestamp on 51 tracks
09/01 23:59:36 Trace: [library/compute] computing 9 tracks
09/01 23:59:36 Critical: Library.EndMutation: System.ArgumentException: The output byte buffer is too small to contain the encoded data, encoding 'Unicode (UTF-8)' fallback 'System.Text.EncoderReplacementFallback'.
Parameter name: bytes
   at System.Text.Encoding.ThrowBytesOverflow()
   at System.Text.Encoding.ThrowBytesOverflow(EncoderNLS encoder, Boolean nothingEncoded)
   at System.Text.UTF8Encoding.GetBytes(Char* chars, Int32 charCount, Byte* bytes, Int32 byteCount, EncoderNLS baseEncoder)
   at System.Text.UTF8Encoding.GetBytes(String s, Int32 charIndex, Int32 charCount, Byte[] bytes, Int32 byteIndex)
   at System.Sooid._WritePayloadToArray(Byte[] ret, Int32 off)
   at System.Sooid.ToArray()
   at FSE.BinaryWriter.WriteSooid(String name, Sooid v)
   at Messaging.FSEMessageWriter.WriteField(String name, Sooid value)
   at MusicDb.LocalTrack.Serialize(IMessageWriter writer)
   at Messaging.FSEMessageEncoder.EncodeMessage(IMessage m)
   at Messaging.FSEMessageHelper.ToByteBuffer(IMessage m)
   at Sooloos.Broker.Music.MusicDatabase._Put(Byte[] key, IMessage msg)
   at Sooloos.Broker.Music.MusicDatabase.TransactionCache`3.Flush()
   at Sooloos.Broker.Music.MusicDatabase.Flush()
   at Sooloos.Broker.Music.Library.Compute(IList`1 tracks, IDictionary`2 load_tracklitedata)
   at Sooloos.Broker.Music.LibraryMutationEnv.Finish()
   at Sooloos.Broker.Music.Library.EndMutation()
09/01 23:59:36 Trace: [library] endmutation in 35ms
09/01 23:59:36 Trace: [metadatasvc] REQ [1467] https://metadataserver.roonlabs.net/md/4/updatemetadata?uid=b9cbec89-7418-49fc-ba89-8db3d810c1c2&lid=&token=4e8676c8-dff0-4b91-810a-dfff174753b4&metadataid[]=6100313939333630343233333237363236&metadataid[]=6100313939333630343233333237363232&metadataid[]=6100313939333630343233333237363237&metadataid[]=6100313939333630343233333237363238&metadataid[]=6100313939333630343233333237363138&metadataid[]=6100313939333630343233333237363139&metadataid[]=6100313939333630343233333237363233&metadataid[]=6100313939333630343233333237363234&metadataid[]=6100313939333630343233333237363239&metadataid[]=6100313939333630343233333237363230&metadataid[]=6100313939333630343233333237363231&metadataid[]=6100313939333630343233333237363235&metadataid[]=7b004d5430303138373437303632&metadataid[]=7b004d5430303138373531313035&metadataid[]=7b004d5430303236323735303637&metadataid[]=7b004d5430303138373439313031&metadataid[]=7b004d5430303239353234323430&metadataid[]=7b004d5430303138373633343831&metadataid[]=7b004d5430303239383633303235&metadataid[]=7b004d5430303138373432343539&metadataid[]=7b004d5430303138373435373337&metadataid[]=7b004d5430303237363933353730&metadataid[]=610035353931373838313531343138&metadataid[]=610035353931373838313531343135&metadataid[]=610035353931373838313531343136&metadataid[]=610035353931373838313531343137&metadataid[]=610036373738323339333036303730&metadataid[]=610036373738323339333036303633&metadataid[]=610036373738323339333036303636&metadataid[]=610036373738323339333036303639&metadataid[]=610036373738323339333036303731&metadataid[]=610036373738323339333036303733&metadataid[]=610036373738323339333036303634&metadataid[]=610036373738323339333036303637&metadataid[]=610036373738323339333036303732&metadataid[]=610036373738323339333036303638&metadataid[]=610036373738323339333036303635&metadataid[]=610036373738323339333036303734&metadataid[]=610036373738323339333036303735&metadataid[]=7b004d5430303436303434323733&metadataid[]=7b004d5430303436303434323732&metadataid[]=6100323034373936363233393732303730&metadataid[]=6100323034373936363233393732303637&metadataid[]=6100323034373936363233393732303638&metadataid[]=6100323034373936363233393732303639&metadataid[]=7b004d5430303037313236383737&metadataid[]=7b004d5430303037303934353634&metadataid[]=7b004d5430303037303339353731&metadataid[]=7b004d5430303036393532373235&metadataid[]=7b004d5430303037313631303138&metadataid[]=7b004d5430303037323230383434&metadataid[]=7b004d5430303036393739313533&metadataid[]=7b004d5430303037313433313432&metadataid[]=7b004d5430303037323335363233&metadataid[]=7b004d5430303037323137383437&metadataid[]=7b004d5430303036393631333137&metadataid[]=7b004d5430303037303635353939&metadataid[]=3e01309d591189fbb04caae3d0c1532e475c&metadataid[]=79004d5730303031363936353937&metadataid[]=3e011e78e410e5b39c4b94a2ce0cf1821f42&metadataid[]=79004d5730303032363839353038&metadataid[]=79004d5730303032343537373330&metadataid[]=3e013e3c15488f1fbb449cadcefae6d78f2b&metadataid[]=79004d5730303030363530363938
09/01 23:59:36 Critical: Library.EndMutation: System.ArgumentException: The output byte buffer is too small to contain the encoded data, encoding 'Unicode (UTF-8)' fallback 'System.Text.EncoderReplacementFallback'.
Parameter name: bytes
   at System.Text.Encoding.ThrowBytesOverflow()
   at System.Text.Encoding.ThrowBytesOverflow(EncoderNLS encoder, Boolean nothingEncoded)
   at System.Text.UTF8Encoding.GetBytes(Char* chars, Int32 charCount, Byte* bytes, Int32 byteCount, EncoderNLS baseEncoder)
   at System.Text.UTF8Encoding.GetBytes(String s, Int32 charIndex, Int32 charCount, Byte[] bytes, Int32 byteIndex)
   at System.Sooid._WritePayloadToArray(Byte[] ret, Int32 off)
   at System.Sooid.ToArray()
   at FSE.BinaryWriter.WriteSooid(String name, Sooid v)
   at Messaging.FSEMessageWriter.WriteField(String name, Sooid value)
   at MusicDb.LocalTrack.Serialize(IMessageWriter writer)
   at Messaging.FSEMessageEncoder.EncodeMessage(IMessage m)
   at Messaging.FSEMessageHelper.ToByteBuffer(IMessage m)
   at Sooloos.Broker.Music.MusicDatabase._Put(Byte[] key, IMessage msg)
   at Sooloos.Broker.Music.MusicDatabase.TransactionCache`3.Flush()
   at Sooloos.Broker.Music.MusicDatabase.Flush()
   at Sooloos.Broker.Music.Library.EndMutation()
09/01 23:59:36 Critical: Library.EndMutation: System.ArgumentException: The output byte buffer is too small to contain the encoded data, encoding 'Unicode (UTF-8)' fallback 'System.Text.EncoderReplacementFallback'.
Parameter name: bytes
   at System.Text.Encoding.ThrowBytesOverflow()
   at System.Text.Encoding.ThrowBytesOverflow(EncoderNLS encoder, Boolean nothingEncoded)
   at System.Text.UTF8Encoding.GetBytes(Char* chars, Int32 charCount, Byte* bytes, Int32 byteCount, EncoderNLS baseEncoder)
   at System.Text.UTF8Encoding.GetBytes(String s, Int32 charIndex, Int32 charCount, Byte[] bytes, Int32 byteIndex)
   at System.Sooid._WritePayloadToArray(Byte[] ret, Int32 off)
   at System.Sooid.ToArray()
   at FSE.BinaryWriter.WriteSooid(String name, Sooid v)
   at Messaging.FSEMessageWriter.WriteField(String name, Sooid value)
   at MusicDb.LocalTrack.Serialize(IMessageWriter writer)
   at Messaging.FSEMessageEncoder.EncodeMessage(IMessage m)
   at Messaging.FSEMessageHelper.ToByteBuffer(IMessage m)
   at Sooloos.Broker.Music.MusicDatabase._Put(Byte[] key, IMessage msg)
   at Sooloos.Broker.Music.MusicDatabase.TransactionCache`3.Flush()
   at Sooloos.Broker.Music.MusicDatabase.Flush()
   at Sooloos.Broker.Music.Library.EndMutation()
09/01 23:59:37 Trace: [metadatasvc] GOT [1467] (220ms) Sooloos.Msg.Metadata.UpdateMetadataResponse: 
09/01 23:59:37 Trace: [metadatasvc] REQ [1468] https://metadataserver.roonlabs.net/md/4/getmetadata?uid=b9cbec89-7418-49fc-ba89-8db3d810c1c2&lid=&token=4e8676c8-dff0-4b91-810a-dfff174753b4&metadataid[]=6100313939333630343233333237363236&metadataid[]=ae01fafd79d292718a45bd75e3566eca8265&metadataid[]=3e01b0972b438249994bb85e4ea5bd336090&metadataid[]=5e0192fdfa6745390749a199f327a6c2c8f5&metadataid[]=7a004d4e30303030303531373336&metadataid[]=6100313939333630343233333237363232&metadataid[]=ae0165cc39483ed7e44e8e29530dfe3fe5f7&metadataid[]=6100313939333630343233333237363237&metadataid[]=ae01e41a35ca7f278842a83e0e09b5d54783&metadataid[]=6100313939333630343233333237363238&metadataid[]=ae01049a65f016c36a4da8683cfb7c395411&metadataid[]=6100313939333630343233333237363138&metadataid[]=ae01dd46c43c5c4c48439b6519aad91e7965&metadataid[]=6100313939333630343233333237363139&metadataid[]=5e012624562758d52d4dab84b83d1d887a0f&metadataid[]=ae012648088d9a254c48baacacca7626af4f&metadataid[]=6100313939333630343233333237363233&metadataid[]=ae01d54227d1dc503e4fbc09492e05265d5e&metadataid[]=6100313939333630343233333237363234&metadataid[]=ae01512a3d889c5e1c4a873eb94941f04307&metadataid[]=6100313939333630343233333237363239&metadataid[]=ae01838103e6333c12428d7afe72a9913ae0&metadataid[]=6100313939333630343233333237363230&metadataid[]=ae01cf2384b9a6ecfc4a87e0ec834d3ff4a1&metadataid[]=6100313939333630343233333237363231&metadataid[]=ae0127f27116f939f54ab497741887eba938&metadataid[]=6100313939333630343233333237363235&metadataid[]=ae012b2945b2a46b8c42832e29fda7b2eef5&metadataid[]=7b004d5430303138373437303632&metadataid[]=7b004d5430303138373531313035&metadataid[]=7b004d5430303236323735303637&metadataid[]=7b004d5430303138373439313031&metadataid[]=7b004d5430303239353234323430&metadataid[]=7b004d5430303138373633343831&metadataid[]=7b004d5430303239383633303235&metadataid[]=7b004d5430303138373432343539&metadataid[]=7b004d5430303138373435373337&metadataid[]=7b004d5430303237363933353730&metadataid[]=610036373738323339333036303730&metadataid[]=5e010508e162ff73144e94acd3987001077b&metadataid[]=5e018dcecc3b1e2e394b89c63a2ef9a4d501&metadataid[]=610036373738323339333036303633&metadataid[]=ae018ccfff46db24b545bd62fe6f3b3e39d4&metadataid[]=610036373738323339333036303639&metadataid[]=610036373738323339333036303731&metadataid[]=610036373738323339333036303733&metadataid[]=610036373738323339333036303634&metadataid[]=610036373738323339333036303637&metadataid[]=610036373738323339333036303638&metadataid[]=ae01c830009e3171bb49b704ff9f277aa013&metadataid[]=610036373738323339333036303635&metadataid[]=610036373738323339333036303734&metadataid[]=ae0104cc87803a0fde4ca29162b54d4a16a4&metadataid[]=610036373738323339333036303735&metadataid[]=7b004d5430303436303434323733&metadataid[]=7a004d4e30303032353435393031&metadataid[]=7b004d5430303436303434323732&metadataid[]=6100323034373936363233393732303730&metadataid[]=5e01b9b709562c23bf418ead035bc770860e&metadataid[]=5e01691ff688dee37d4d8a4f2e56bd37586d&metadataid[]=6100323034373936363233393732303637&metadataid[]=6100323034373936363233393732303638&metadataid[]=5e0116267b15d2acbb4bb86a7e7e6ed4bd9d&metadataid[]=6100323034373936363233393732303639&metadataid[]=5e01c1b24502ee62fd47ad50291c6306c12b&metadataid[]=5e01296e1d694acd1149a1d219441d4b0d0c&metadataid[]=5e0116a4fdc61a48d54c90cc961a03db6b4b&metadataid[]=7b004d5430303037313236383737&metadataid[]=79004d5730303030363530363938&metadataid[]=7b004d5430303037303934353634&metadataid[]=7b004d5430303037303339353731&metadataid[]=7b004d5430303036393532373235&metadataid[]=7b004d5430303037313631303138&metadataid[]=ae0122b82cbd0f4a3f4e88652ac234f95ba7&metadataid[]=7b004d5430303037323230383434&metadataid[]=7b004d5430303036393739313533&metadataid[]=7b004d5430303037313433313432&metadataid[]=7b004d5430303037323335363233&metadataid[]=7b004d5430303037323137383437&metadataid[]=ae019dcfdb6556588535bc69b879e95d3957&metadataid[]=7b004d5430303036393631333137&metadataid[]=ae0138245a37ac89f34eb5f8d2f3dd0afe93&metadataid[]=7b004d5430303037303635353939&metadataid[]=3e01309d591189fbb04caae3d0c1532e475c
09/01 23:59:37 Critical: Library.EndMutation: System.ArgumentException: The output byte buffer is too small to contain the encoded data, encoding 'Unicode (UTF-8)' fallback 'System.Text.EncoderReplacementFallback'.
Parameter name: bytes
   at System.Text.Encoding.ThrowBytesOverflow()
   at System.Text.Encoding.ThrowBytesOverflow(EncoderNLS encoder, Boolean nothingEncoded)
   at System.Text.UTF8Encoding.GetBytes(Char* chars, Int32 charCount, Byte* bytes, Int32 byteCount, EncoderNLS baseEncoder)
   at System.Text.UTF8Encoding.GetBytes(String s, Int32 charIndex, Int32 charCount, Byte[] bytes, Int32 byteIndex)
   at System.Sooid._WritePayloadToArray(Byte[] ret, Int32 off)
   at System.Sooid.ToArray()
   at FSE.BinaryWriter.WriteSooid(String name, Sooid v)
   at Messaging.FSEMessageWriter.WriteField(String name, Sooid value)
   at MusicDb.LocalTrack.Serialize(IMessageWriter writer)
   at Messaging.FSEMessageEncoder.EncodeMessage(IMessage m)
   at Messaging.FSEMessageHelper.ToByteBuffer(IMessage m)
   at Sooloos.Broker.Music.MusicDatabase._Put(Byte[] key, IMessage msg)
   at Sooloos.Broker.Music.MusicDatabase.TransactionCache`3.Flush()
   at Sooloos.Broker.Music.MusicDatabase.Flush()
   at Sooloos.Broker.Music.Library.EndMutation()
09/01 23:59:37 Trace: [metadatasvc] GOT [1468] (222ms) Sooloos.Msg.Metadata.GetMetadataResponse:

Hi Vincennes, Not official support just a fellow user. Have you tried rebooting the core machine (I didn’t see you mention it, or I must have missed it if you did). Are you running the 32 or 64 bit version of Roon? Or are you running RoonServer?

Hi @Vincennes_Wong,

What kind of device is your media stored on? Any change after a reboot of the Core machine and whatever device the media is stored on?

Thanks both for reply.

It’s a fresh reboot of all stuff including the NAS, router and PC… My roon server running on 64 bit with a NAS mount to my Windows 10 Home.

Device media sure are there intact. Just the library sinking and can’t import new albums.

Removed the Tidal link already. And for resync. No luck…. :pleading_face:

Can you share a screenshot of Settings > Storage, @Vincennes_Wong?

Please also use the directions found here and send us over a set of logs using a shared Dropbox link (or any other file sharing service). Thanks!

Thanks @dylan

Here is the log: Dropbox - Vincennes_Wong.zip - Simplify your life

I always have different # of tracks shows every time I close and start roon or restarting PC. Interesting…

Just to add a capture after stop and start the roon server for getting the log:

Hi @Vincennes_Wong, I’m sorry for the late reply. I just wanted to reach out and confirm that we’re still on this and I’m waiting for feedback from our QA team. I saw some errors in the logs that I need some insight into, and once I have that I’ll follow up ASAP.

I’m patiently waiting…

Hi @Vincennes_Wong, I’ve sent you a PM.

noted and the requested file uploaded.

Kindly help as I can’t use Roon now after the version update. :sweat_smile: