I actually prefer Gauntlet Legends’ take on camera control from Nintendo64. They never drag you along and it creates more interaction (see multiplayer fun) from you yelling at your friend that you need to move on to the next location.
I would just remove the part where you even move the other character. The entire point is to locate the center point of all characters playing on screen and focus the camera towards that point while keeping every character in view.