Currently, the cloud needs rebuilding to propagate any changes to the buffer on the GPU, otherwise, you are changing the values stored in RAM only (I have a potential solution for it tho, which I’ll try to test soon).
The scale and offset are applied to the point itself, so it should be the same everywhere.