You might try the option I highlighted below in the Editor Preferences list. This will use the distance to the selected object(s) to modulate the camera speed. Since it depends on the active selection it can have some odd behaviors if objects very far outside the viewport are selected, which is why it is not enabled by default (in a huge game level it is very easy to accidentally select something very far away)
