Running with a loaded DLSS plugin on UE5.1.1 on a PC that does not support DLSS does not crash on PIE.
A temporary workaround would be simply to disable DLSS then.
Alternatively download the plugin from the NVIDIA site, the zip will contain enough documentation on how to configure it or disable it if you still need the plugin to be loaded.