Changing items players spawn with

Does it work with the PIE(Play-In-Editor)?

Or are you referring to after you cook it and try to play in the actual game?