Since I found this while I was searching myself, I figured I’d post the solution I found.
Manually set in your Engine ini -
[OnlineSubsystemGooglePlay.Store]
bSupportsInAppPurchasing=false
According to UEDeployAndroid.cs, this is the ini setting which adds the billing permission, even though I don’t see it when looking in the Project Settings UI.