Disabling collision has no effect without an additional delay. Tried this by disabling collision on the actor entirely and by disabling collision on the specific mesh the character is colliding with.
The delay is just there to give me a couple seconds to jump onto the object before it teleports. With the code above, the object and the character teleport then the character falls through the cube.
If I add an additional delay between the disable collision and set actor location it “works” but this is a poor solution as it is prone to timing issues (especially when network play is taken into effect)