I just noticed, as soon as I add a static mesh somewhere in the level that has the shockwave material applied to it, then the particle effect keeps working when attaching to a player controller.
As soon as the static mesh is not visible any more or I delete the mesh from the level, the particle effect is invisible again.