We had the same problem, but never fully fixed it.
However, we tried changing antialiasing method and found that TAA gave a better result (for our use case). We also tried to change the computers GPU to a RTX4090, which reduced this drastically.
(Our VR project was not standalone)