Same concern here. Hoping someone finds a clever solution. I’m using Ropieee, which I assume means fan settings like those in Raspbian can’t be accessed.
I did notice someone in the post Anyone tried a POE HAT? mentioned a fanless POE HAT.
https://navolabs.com/product/raspberry-pi-3-micro-poe-h