Using 'Height to Density' Breaks the Difference Modifier Functionality

My issue is exactly as the title says. The difference modifier for all my models works properly until I want to use a Height to Density node and it completely breaks the difference modifier.
If I plug anything into the Differences input of the difference modifier, it removes 99.9% of all instances of that model with maybe 2-3 still on the map.

I do not want this to happen but the Height to Density is causing the Difference Modifier to ignore some overlaps. Setting it to Minimum or Binary has no effect.

Does anyone have any answers? I just remove the Height to Density node and I’ll do something else.
I’ll probably have to open up a bug report later because this interaction is not proper.

I found an alternative way to procedurally generate foliage without using the pcg. The bug itself is still unsolved.