I believe umaps are binary files, and you can’t diff binary files. However, not all files are binary, which is why the option exists. I’d file the bug report as a description of the behavior you’re seeing, the expected result, and the things you’ve tried to resolve the issue yourself and a step by step repro of the problem.
Hope this is helpful.