Strange camera rotation with physics based skeletal meshes

Ok it looks like I solved it!

In the export options of Blender, I had to set the forward and up axes, but also had to tick off the Apply Transform option. Looks like it works now!