Your description sounds a little different from mine. I had interminable delays in Qobuz tracks starting. But each track would typically play fine once it got started.
For me, it was an IPv6 versus IPv4 issue. Changing DNS servers didn’t really help. Editing /etc/gai.conf to prefer IPv4 addresses did. I have had no further problems with Qobuz after making that change.