is there a way to generate a Curve Vector from an array of coordinates in the world space?

Of course by blueprint, create a blueprint actor and add the spline component into it.

Then in the construction graph try using the following with your array of vectors