I have got the same. I fix the problem, In Unreal Engine 4.18 go to Project Settings, then go to Asset Managuer, and there are a list named “Specific Assets”, add all your maps, and other stuff you want to be in yor game. I did that and launch the game for windows, and all maps work fine.
Hope this help, if you did not solve your problems already.
luck with your project.