Yes, it only works on brushes, not on static meshes.
If you want a hole in your Asteroid Mesh, you first have to export your Asset(as FBX or .obj) and import in Blender to edit it.
Here is the export option(sidenote: i convert the box brush into a static mesh - you can find the option inside the detail panel if you select your box brush):
