Lag when moving particles

I’m trying to move a particle system to have it hover a few meters in front of the camera pointing in the direction of another object. The position works (tested with other objects), but when I put in a particle system, I get a massive lag of about a dozen frames.

Is there any way around this lag (apart from baking the particle system)?