I ran into the same issue (very small scene, nothing complex going at all) and was reaching similar levels of frustration as @araz01.
This might not work for them but it was resolved for me by replacing the batteries in my wireless mouse with new ones. I assume even just a slight drop in power there caused this problem because it really didn’t show up anywhere else.