Reference time take too long

Hi guys I am stucking in this problem for a long time, I think I got a reasonable deep direction tree in my content which is about 7 levels? but now even I try to delete the start point in default map it takes me about 30 min to refresh the refernece. how to improve the speed?