Realistic mirrors in VR

Hey guys,

I´m working on a VR-Driving simulation and need to implement side -and rearmirrors in VR. I`m using a SceneCapture2D setup for every mirror. Now I have the problem, that the SceneCapture2D Camera has to rotate in a realistic way. So if the user moves his Head the mirros has to change.

Currently I´m trying to archive a realistic behaviour with a look-at vector. But it doesn´t feel realistic.
Any ideas how to archive a realistic behavior of viewpoint and rotation in VR?