I found a solution different than OP and I wanted to share with anyone else that stumbles upon this. I had a pretty simple glass material (Translucent) that was used in a lot of the assets I owed but I sadly kept getting the problem even with thin translucent and surface forwardshading. So instead I made the material masked and used the green color channel(This will differ for you if they choose different colors for different data) from the “ORM” texture as the opacity mask. Then I simply enabled Differ Opacity Mask since I’m using Temporal AA this treats the material as translucent, atleast thats what the tool tip says and it works how I think it should work.
Gif of it before -
And a Gif of it as a masked material with the dithered checked
Screen shot of the translucent material before I changed it to masked -
And it as the masked material -
Hope this helps the next guy