I decided to stick to the original setup.
Now I’ve got the next issue.
The hands apparently are offset to the debug spheres.
Why is that and how can I fix this?
If the bones matched the spheres perfectly or at least more closely, very accurate tracking would be possible.
The way it is now, overlaps may happen breaking some immersion.