It should work if your stitched pictures was not too distorded (in a way non solvable by the lens model equation).
Can you provide a sample ?
You can try to do a draft alignment and see if this is better.
You can also try to do cube faces that overlap (more than 90° field of view).