Possessing and Unpossessing different pawn

In your Pawn’s Blueprint check Auto Possess Player and Auto Receive Input if it is set to Player 0.