That would be “True FPS Mode”, I have seen a couple tutorials, but basically to do you would want to start with the third person template, go into the MyCharacter blueprint components and delete the "CameraBoom"component.
Then move the camera so it lines up perfectly with the actual character, similar to screenshot I found:
You will also need to modify the controls so the character moves correctly with the camera, but that is the basic setup.
Here is a tutorial that goes a bit further with , it is for Oculus but the basic idea is the same.
https://wiki.unrealengine/Oculus_Rift#True_First_Person_Viewpoint