Low res pic, hard to read so I’ll ask:
Are you using a Widget Interaction Component for this? As this would be the way to handle it. It does pretty much all you’ve described, including tracing and key emulation - so you’d press F and have the widget treat it as a mouse button, evoking button presses and so on…
World Space Widget Component. So you’re pretty close.