Correct, there is only one anchor. When you place and enable VXGI Anchor component, you override the default one attached to the camera.
If the scene is completely static and the anchor is static too, you can hack the engine to stop doing all the voxelization calls after a few frames… the main problem I guess would be to detect when you can do that.