BackGround audio analysis speed stalls [Investigation Started]

Sorry @daniel I think asking a customer to rebuild their library is a bit much. This is a problem that creeps up far to often and many posts on this topic none with a clear answer. Mine from October last year was cloesd and not one support reply!! Audio Analysis keeps getting stuck - #6 by Menzies. In some cases it might be a corrupt file but in mine the way it displays indicates its not and its not all the time.

I know this issue affects two other users quite often when importing in large amounts of tracks.

In my findings say you import 50 fiiles it may get it stuck at 49/50.Stop/start analysis it clears, however if you add another 30 files it will get stuck at 28/30, add in 15 next time it wiill get stuck at 12/15. See a patten here. Rebooting or restarting the server, will clear it completely unitl next time it decides to have a blip and then it will be back to just one of the batch you added that will get stuck, its not the same file everytime. If it is down to corrupt files or an incomplete analysys then there needs to be better reporting in Roon, you cant expect a customer to work out what this will be.

3 Likes

Thanks, @Simon_Arnold3!

I too would have thought that standard troubleshooting procedure makes it best for us to concentrate on these aspects of your and others’ experience:

* I just imported this CD: 32 tracks + folder.jpg cover art. Now Roon analysis has stalled on 1341 / 1346; the usual fifth from the end.

Which logs will you and your team be looking at, please; and what data will explain this?

1 Like

@daniel - having continued to observe closely the stalls, I can confirm that:

  1. the ‘current’ and (presumably a calculated) ‘total’ numbers don’t immediately seem to me to correspond to (recent) imports… for example I just imported this set of 11 CDs; nowhere can I see how 1,508 could correspond to a figure in any new or recently-updated track total in my Library, or the delta with last time. Is this something that you would elicidatre for us, please, Daniel? Thanks!
  2. the stall always occurs five tracks from said (presumably a calculated) ‘total’ number:

Looking forward to the results of your investigations…

Hi @Mark_Sealey,
We’ve spoken to our dev team about this issue today. We have discussed several theories, but the most likely one is that Roon was still trying to analyze these 5 files, but there was a timing issue and the album IDs changed in Roon as analysis was taking place. Our QA team is trying to reproduce this scenario in the lab to see if we can observe this live, but testing for this takes some time, we will let you know if we require anything else for testing this. Thank you in advance for your continued patience.

1 Like

Thank you very much, Daniel! Thanks for your perseverance.

I confess to being a little puzzled about this, though:

and I’m sorry if I wasn’t clear: this stall happens every single time with every import which I make.

So wouldn’t your colleagues’ suggested theory be more likely to apply to one instance?

Surely IDs don’t change and cause these stalls for so many of us every time any of us imports?

More details would be helpful, please?

Particularly since others are experiencing this!

Do I have access to the same logs as you do?

Could I look at them; if so, what exactly should I be looking for?

Would it help for me to advise you of the exact UTC, PST, EST moment when I next do an import?

Hi @Mark_Sealey ,

Yes, you can access logs with the following instructions:

The QA team is trying to get to the bottom of this, but we have not yet been able to determine the exact files affected or how to reproduce behavior on our end yet. We’ll update you when we have more details to share from QA.

1 Like

Thanks, noris!

I have located the logs in question, I think; on my Nucleus from my iMac Pro (13.6.4):

/Volumes/Data/RoonServer/Logs/RoonServer_log.nnn

Yes?

I can carefully copy (ie not move!) the current (e.g. 'today’s date) log to my desktop and examine it in BBEdit.

I can correlate from my system clock when the stall appears to start.

But what exactly should I be looking for, please?

OR, when you say:

should I understand from this that your servers themselves ‘know’ which FLAC (etc) files I have stored in Roon and that your team is examining this correlation?

If so, maybe I should hold off trying to make sense of the log files.

In any case, may I thank you - again - for your persistence with this! It’s much appreciated - from a lifer fan :slight_smile: !

You can replicate it by moving an album directory or rename a file whilst it’s processing it will get into this state from their on adding in any new material. If you stop analysis it will clear temporarily until you add some more, a restart of server seems to clear it. It would be handy for Roon to have a feature that will identify which files have failed to analyse then a user can possibly fix it and then perhaps a reanalyse. We have skipped files so this would be an extension of that.

1 Like

Thank you, @Simon_Arnold3!

@noris and @daniel - that is pretty much my experience, as CrystalGipsy describes.

Except for me it’s:

  1. adding any album, which of course is before Roon starts processing
  2. stop analysis (or changing the level from Throttle to 4) it will clear temporarily until you add some more
  3. for me so far a restart of server does not clear it.

Agreed! Even if at the ‘hidden preference’ or ‘for tech support’ only level :slight_smile:

I’ve got confirmation there is a internal ticket for this behavior. I’ve seen it on 3 totally different roon setups. Nucleus, rock and a roonserver on ubuntu 22.x.
It’s easy to trigger this. Just rename one or a couple of folders on your storage roon is watching and the audio analyses stalls at some point. Same for renaming, adding metadata to files on the roon watched storage

See this thread Audio analysis crashes when renaming files/folders in library [Ticket In]

2 Likes

Hey @Mark_Sealey !
Thanks for your patience!
According to the logs, It is not so obvious to understand what is going on. So for the next part of the investigation let me ask you to do the following steps to figure out which tracks from your library have problems with analysis:

  • Restart the Server
  • Let it work for 5 minutes
  • Restart the Server again
  • Let it work for another 5 minutes
  • Save the logs
  • Share the logs with us

Thank you!

1 Like

Thanks for your persistence, @andrew.v!

Of course, I can do that.

As soon as I hear back from you, please - after we’ve made 100% sure that I’ll be providing you with the exact data you need at this point.

So I’m going to:

  1. stop/quit the server from/in the macOS Menu Bar (your steps 1, 3)
  2. relaunch it at/from /Applications/Roon/Roon.app/Contents (your steps 1, 3)
  3. run Roon as normally: do I play music or not at this point? (your steps 2, 4)
  4. save today’s log (‘RoonServer_log.txt’) at /Volumes/Data/RoonServer/Logs

Yes?

If so, what’s the best way to send you that log?

Thanks again; I look forward to hearing from you and supplying you with the data you need to solve this.

At least yours got acknowleged mine didnt get a single reply and was closed.

@Mark_Sealey The exact steps are:

  1. Go to the Nucleus web page in your network, (eg. 192.18.x.x, depending on your device network address) and click the Restart button. This will restart your Server.
  2. Let it work for 5-7 minutes
  3. Repeat Step 1
  4. Let it work for another 5-7 minutes (no need to play the music)
  5. Archive the whole Logs folder at /Volumes/Data/RoonServer. You may share it via any cloud storage you are using
2 Likes

Surely, it’s likely that the work which Andrew and his team are doing here will help us all :slight_smile: .

@andrew.v,

Thank you. A little different from what I was going to do - so doubly helpful :wink:

I’ve sent you a Message here with details of how to download the logs. Please confirm that it has worked and that you can see them.

If necessary, I’ll repeat with a newly-added set of music files - so that your steps 2 and 4 might show the stall in progress.

Thanks again!

I hope so. But yours seems to be a slightly different issue than mine and the ticket created by @Edwin_Muskee which is exactly same as mine.

CrystalGipsy,

Yes! Could well be! But it does look to me (as @benjamin says) that:

Which would be good to know… maybe an underlying bug that, because it can be triangulated from (at least) three (somewhat different) sources and behaviours, can relatively easily be fixed.

1 Like

It’s indeed the counter or forked process for audio analyse that’s stuck but (my theory without the source code):
Audioanalyse starts when there is a change in the directory('s) watched by roon (logical).
Whenever I move/copy change something in the watched directory audioanalyse starts and gets stuck in the end because the original folder is changed or even not there anymore.
Solution: add a timeout how long audioanalyse can run on a specific file and after the results/output of audioanalyse check if the file still exists in the same location, if not discard the output of audioanalyse because it’s not relevant anymore and don’t try to add it to the database of roon where the file is gone in that particular location.
This whole thing never happened in earlier 2.0 builds of roon…

(Just my 2 cents)

2 Likes

Since there is not a single reaction yet from @metadata_support , just this one-line post to prevent the topic being closed automatically

1 Like