Okay, had some more time to keep digging and just in case anyone wonders: The Visualization Trait has a parameter for max counts for each LOD:
This did the trick on my side and I can continue testing.
