Replication struct within actor component not working

In case someone else will have similar issue. All I had to do was to run the function which updates the structs on the server side with UFUNCTION(Server, Reliable)