Level Sequencer Parameters Breaking Over Time

So an interesting thing has been happening with a parameter I have set during the levels sequence.

So, for a bit of backstory, I have a material that I have a X & Y parameter set to I can have it move in any direction during a level. It works great and have had not problems with it.

I then added the Parameters to Level Sequencer (X & Y) so over the course of the level I can change its speed and direction to the events.

During the development I have been testing this with entering the values, hitting play, and observing for say 30 seconds to make sure it is the correct speed, and after its good move down the timeline for the next value ect ect.
However, I was doing some tests with playing the level for several minutes instead of the 30 seconds for just testing, and I noticed something happening.

It works perfectly fine approximately 1:30 seconds and moves as it is instructed in the level sequencer, but after 1:30 I noticed it starts to slow down, and then altogether just stops.

After extensive testing, I have determined after X amount of time playing the game, the material will start to forget the values in the keyframes until it just stops moving altogether.

But if I say start at the 3 min timestamp in the level as my starting point, and say at the 4:30 min mark the material starts acting funky, if I set my starting point of the level at the 4:30 min mark, it works perfectly fine until a min or two passes and then it starts breaking.

Using the graph editor, I have figured out that this problem only occurs at points when the values are not moving in a semi flat line. (and this only occurs in game after playing for several minutes)

For example, in the following screenshot, I start at the 249 mark, after it starts breaking, it will fix itself once it gets to the point where it flattens out and then re correct itself. (The part just past the 300 mark)

Was wondering if anyone has any ideas on why this would happen?