Pawn/character losing control when switching from one pawn/character to other

So I have a third person character and a Pawn that I created for orbiting around like you would when implementing dollhouse view.

The issue is that I have tried using a custom Player controller to implement it but it didn’t work. The issue is that one pawn/character loses the input functionality when switching.
When it didn’t work, I then tried with an Event dispatcher in the widget. This is having that same issue.
Attaching a video to showcase my bps and the issue.

Sorry, I forgot to add something. The pawn that is going up and down when pressing Q and E is only working. This movement is added using Input Axis while the rest of the controls are being implemented by Enhanced Input Mapping. The reason to add Input Axis for Q and E is because it didn’t work with Enhanced Input for some reason.