Having gravity work without collisions

1 - create your own collision channel in settings like this:

2 - in the collision settings of your object just select custom and put BLOCK only to your custom channel created and ignore all others like this:

good luck