I wonder if your ffmpeg isn’t right.
Can you play these test files in aac?
https://filesamples.com/formats/aac