Setting Scale in Actor Component kills Velocity

I have set up 2 actors, both have physics enabled and gravity off.
Both actors have an AddImpulse in their BeginPlay event.

One actor has no actor component, and gradually reduces it’s scale by 0.01% in its own Tick Event.
The other actor has an actor component, and the actor component reduces it’s owners scale by 0.01% in its Tick Event.

The first actor moves smoothly at a constant pace.
For the second actor the movement is greatly hampered. This effect was amplified while recording, making me think that CPU usage has some sort of influence.

Video (zipped)