So, I fixed it somewhat.
Instead of 2 camera’s I just used 1.
And lerp the values around. I am attaching images below so if anyone seeks to do something similar regardless of perspective. This should help out quite a bit.
I decided to make 2 Macro’s for cleanliness-sake, no need to worry you can directly hook-up all the nodes if you don’t like macros.
This will be the result.
Hope it helps. Cheers!