I don’t really understand the topic entirely, I don’t think, but you’re either using the wrong data structure, or you’re using the right data structure in an incorrect way.
If your code can’t handle a member of the data structure disappearing, then you can’t really expect to use a TArray. I think the problem is more on how you’re accessing the data in the list, than what the list is, though.