How can I disable collision only for bullets?

I have a custom tree static mesh in my map.
Using the mesh editor I managed to create the collision only around the bark, so leaves do not collide with players.

My problem is: When I shoot with a weapon at the leaves, the bullets get blocked instead of passing through them. I saw other maps with no weapon collision on the leaves (or even fortnite props) so I know there is a way to do this, but how?
Do I have to set something in the material or in the mesh?

Set the “Collision Presets” on the mesh to “FortCreativeOnlyWeapons”. This should block only weapon projectiles.

But I want it to block everything except weapons projectiles and only for the leaves… I’m starting to think I have to make 2 separate meshes, one for the leaves and one for the bark