Well, after a bit of clicking around, turns out you need to activate “Show Grid” in the viewport to make the bounds show up, otherwise they only appear if you have selected a children of collider:
