Can you move the object of interest on a white backdrop while keeping the camera stationary? Or should the object remain stationary and the camera be moved around the object?
What you describe is basically a turntable and yes, that works fine, as long as you make sure that RC cannot track any (or only very few) tie points on the background. The less texture, the better.