Phone as Controller

You could use the OSC protocols for doing this (OSC is a control protocol used by many sound interfaces so they can be remote controlled). I used an Unreal Engine plugin (which I forget the name of) as the OSC “server” and then had an android app using a thing called OSC Widgets as input device for an experiment I was running. It runs over a network and has pretty simple usage. I’d recommend investigating it.