So I was able to get passed this by changing Maximum number of parallel project builds to 1 in Visual Studio (Menu> Tools > Options > Projects and solutions > Build and Run. )
Of course this is not the fastest, but it seems to resolve error which I assume is caused by race condition and simultaneous building