Gear VR video texture only works if you look straight ahead

Fixed it I think by turning off Occlusion Culling under Project Settings/rendering