I would try painting less of the cloth. Mainly just the edges.
And go into ChaosClothConfig on the left and start testing settings to make it a lot more stiff, such as maybe:
Density (has an interesting tooltip)
Gravity Scale
Right now it looks completely floppy, so it’s going to lose all of it’s shape and fold in on itself. For that dress I’m thinking you’ll want a LOT less simulation than you think.