I was able to solve this issue by creating a custom function in the game instance next to the Init() and Shutdown() functions.
I called it RestartSubsystems() and all it does is call:
SubsystemCollection.Deinitialize();
SubsystemCollection.Initialize(this);
This solved the issue for me! Wooo