Eyes sometimes show different LODs in VR, how to fix that?

I’m often seeing that the left eye shows a different LOD of a mesh than the right eye. Since the screen size of the mesh is different for each eye that makes sense, but in VR it looks really bad if the left eye sees a different mesh than the right eye. It completely ruins the 3D perception, it looks broken.

Since this is quite an obvious problem I would think that there’s some way to fix it, but I didn’t find one. Anyone has any ideas?