Usually after restarting Roon Server and roon on my remote comp its a little faster.
I am on a m1 mini for the core and on an old iMac with Catalina for the remote. What is your Roon Core running on? Sometimes a Clear Image Cache works in bringing back speed.
Or you can generate a new RAATServer instance on your device by following these instructions