How to keep the location of the touch interface fixed in place?

I have a UI being used at the same time as a touch interface and touching the screen anywhere near the UI makes the touch controls overlap the UI and makes using the input harder. Is there a way to fix the inputs in their location?


Seems that reducing the interaction size makes the the interface jump around in a lesser area. But also reduces size of the area where you can touch the screen to immediately control the joystick. So you gotta find a balance