For me the issue was resolved by making my collision mesh the root component (i.e. in the blueprint editor, I dragged my sphere component to the root and replaced it).
I’m binding to the OnHit event of the sphere so maybe that has something to do with it.
Credit: Generate Hit Event doesn't works if simulate physics not enabled