Okay so I managed to get the variant manager working with the following workflow.
Created 2 material instances. One light and one dark.
Created a duplicate of a wall and applied the above two materials to each one.
USed the Variant Manager to set up material swaps and baked the lighting.
Now inside the game, it looks weird. Please look at the attached video to see what I mean and someone help me please