Hi Michael,
I don’t think you’re doing anything wrong. I have the same issue on mine and reported it to Support.
Might be worth you doing the same to get some more traction to get it fixed.
Annoyingly the iPad Pro 12.9” 2018 works fine in portrait mode and since upgrading to the 2020 model I feel cheated.
Good luck!
Rory