UE4 does support testing Google Play games with a local, non-Shipping installation, it just requires some more setup. If you add your debug signing certificate fingerprint in a separate linked app as described here, it should work. Without the logs it will difficult to figure out what’s going wrong.
No, this shouldn’t be necessary.
Yes, we use it in our sample game TappyChicken, which has working leaderboards.