How to stop selecting widgets with artificial mouse clicks?

I am using artificial mouse clicks when I press A on my gamepad with these functions:

void UClicker::ClickDown()
{
	FSlateApplication& FSA = FSlateApplication::Get();
	FViewportClient* Client = GEngine->GameViewport->Viewport->GetClient();
	FKey MouseLMB = EKeys::LeftMouseButton;
	Client->InputKey(GEngine->GameViewport->Viewport, 0, MouseLMB, EInputEvent::IE_Pressed);

	TSharedPtr<FGenericWindow> NewPointer = FSA.GetActiveTopLevelWindow().Get()->GetNativeWindow();
	FSA.OnMouseDown(NewPointer, EMouseButtons::Left);
}

void UClicker::ClickUp()
{
	FSlateApplication& FSA = FSlateApplication::Get();


	FViewportClient* Client = GEngine->GameViewport->Viewport->GetClient();
	FKey MouseLMB = EKeys::LeftMouseButton;
	Client->InputKey(GEngine->GameViewport->Viewport, 0, MouseLMB, EInputEvent::IE_Released);

	FSA.OnMouseUp(EMouseButtons::Left);
}

Works fine until I try to interact with UI. UI gets blue outline after fake clicking it and then it eats all input from my controller button. Looks like it is trying to do something with touch selecting maybe? Either way I just want the fake clicks with no blue outline(As if I manually clicked it)

If it helps, it is the same selection as Tab gives, so is there a way to disable Tab selection/selection in general for widgets?