Tracking flickering with Scene API, Unreal Engine 5

I managed to fix it, in case one day someone encounters the same issue, it was because I had in my Character, in the Class Defaults, in the Pawn Category, the checkboxes “Use Controller Rotation Pitch” and “Use Controller Rotation Roll” checked. Uncheking them fixed the issue.