Have a toggle with right mouse to switch to free-look mode - only works once. Why?

Maybe this might help?

Also check if you are not using right click in other places where it might be fighting with this input.