For testing, I opened the default blueprint Startup Project for Virtual Reality, and I cannot get the PSVR working in VR mode. It just shows the level projected onto a screen in 2D.
I have Enabled HMD on begin play, and I have Enabled Start in VR. Not sure where else to look.