The problem is caused by this commit.
Reverting the commit fixes the problem for my use case and fully restores the old behavior, but I’m not sure about other scenarios and what the commit was trying to fix in the first place.
This obviously only works, if you’re using a source build of Unreal Engine.