Interaction with more actors

Hi,
I’m having problem with interacting with more than 1 actor. I created an interface and it was working just fine. I was experimenting with “keypad code”, using light switch (so when all the buttons are light on the code is completed).
My problem is when I exit the view before I completed the code and if I already interacted with another actor before. It doesn’t make a lot of sense, but when I try to interact with my pad it seems that it can’t immediately interat with the button. The first time is very smooth and quick, but then I have to click almost 3 times before the button is on.
I don’t know how to fix it and it’s driving me crazy. If there’s someone who can help me discover a solution I would be grateful.
Also one of the Keypad I created it’s using a collision box to interact with it, not the Interact interface, so I’m not really sure why its conflicting between the two.

I can show my BP and everything, please help me find a solution.

Thanks

It seems that the problem is very specific. Can you share a video of the problem and the code for interacting (the one that doesn’t work)

I recorded the problem, I hope this way is more clear what is my issue.
I focused on the one with the interacting system, as you can see in the video when I re-focus on the pad it’s really slow and I have to click several times before something happens
2025-03-23 17-04-20.mkv (13.4 MB)

Sometimes there is also a bug on the false “set material” at the end of the “Toggle Function”, but it seems to work anyway so i don’t really know. This is he video of the BP:
2025-03-23 17-07-59.mkv (15.9 MB)