Camera is going crazy when character is moving backwards

You have concurrent updates in your blueprints.
Something tells camera to look forward, something else to rotate.
Most probably is that you have camera arm set to inherit some rotation from controller.
You either find what is fighting what over camera rotation.
Or you add camera lag (this is bandaid solution).