Does UE4 automatically close/destroy old level when you load new one with "open level" node?

Yes, the old server is removed from memory when you move to another one.