Figured it out after much thought. I made an arrow in the blueprint, attached it to the capsule component, get its world location and then set that location in a vector variable.
Then when I play the timeline, it lerps from my actors currently location to the set variable location. This way every time a pushback event is triggered it will grab a new location and move it there.
