Is it possible to prevent overlap but detect collision?

The collision is then set up incorrectly. Set Block All (for now), follow the instructions in the tooltip.

If I allow overlap, the event fires

Hit Events do not fire on overlap - so you have something dodgy going on there.