After switching to 5.4 from 5.3, I lost 10 frames and 12ms per frame.
Maybe you need to turn something on or off?
I use Niagara to represent MASS entities, perhaps this is influenced by what writes to me that I use VectorVM_Legacy?
5.3:
5.4:
The source that I use is legacy VectorVM: