Deleting the files in the user Library will require either letting Room recreate the database or it can be restored from a backup.
I have over 30k tracks in my local library, I’m a bit overcautious and have my music library backed up in 3 locations and have Roon backup the database twice a day in separate locations.