Well, that didn’t take long. I found it stops happening when I turn on always relevant for every item. It still shouldn’t happen though, any ideas why it does? I can’t use always relevant for all the items on the map 
EDIT: Okay, I think I found how to fix this. When I pick up the item that is the main one with the currentStacks I have to set the controller that picked it up as its owner, then it works just fine. Gonna keep this here for anyone else that will have this problem.