I’m not sure how much this will improve performance, but you can try drawing all widgets on the HUD, setting their position via Project World Location to Widget Position.
In this case, you can use the Invalidation Box to improve the rendering of many of them (in theory).