Which HQP Filter are you using? [2015-2023]

Do not use sinc-M for such low rates, the delay will be just annoying. Since million tap filter has 500k samples delay, that will be already about 5.5 seconds at 96 kHz. It is intended for 705.6/768k or higher output rates.

If you want same filter with sensible delay, use sinc-S.