Ok, the problem was in the TAA, changing it to FXAA removed the issue (still, I needed to lower the blur amount).