It seems like the device orientation setting under Project Settings->Android is being ignored when launching the project on a device. I’ve only tried Reverse Landscape and Sensor Landscape but the project launches and stays at the default landscape orientation.
Thank you for reporting this issue. I have been able to recreate what you have been seeing with the screen not orientating to the correct location. I have written JIRA report UE-11383 and placed it into our bug database so that the issue may be resolved in a future release.
Please let me know if you have any additional questions regarding this issue.