How can I setup box collision to overlap specific mesh in player pawn only

Usually what I would do is use a “cast to” to make sure only a specific mesh will trigger a box collision like below

But I can’t find a cast to for my motion controllers I have set up in my VRPawn

Probably because the “Cast to” only works for blueprints. In the above picture you can see my left and right controller L & R. How can I make the box collision ignore everything but the controllers?