So It’s not perfect but it works now. My solution was to set my button actor to not replicate and on my main BP replicate the actor in the child actor component.
I don’t know why it works better that way but I will answer as resolved for now.
