Yesterday, I simulated an Internet down by unplugging the external cable from my router. Right away, I tried to play one album briefly like a minute and then changed to another album and hit play on that second album. The second album stopped playing after 2 seconds, with the progress bar frozen and the play button showing a triangle play button, not a double bar pause button. Pressing that triangle play button did not anything.
So, all in all in about a couple minutes it stopped working.