I’m having a similar problem with both my Android and my Windows 10 laptop.
Core machine is AMD Ryzen 5600X w/32G RAM running Linux Mint 20.1.
Network is AT&T Gigabit modem running WiFi to phone and Win10 laptop, but Gigabit Ethernet to Core.
Audio devices are either Edifier speakers connected to core through Schiit Hel 2 or Google Nest Mini through WiFi.