Yes, this is also seriously affecting one of my published maps. It’s a sports experience where players are supposed to kick or shoot the ball, but they end up thinking they should hit it with the pickaxe, making it much harder to control where the ball goes, causing player frustration.
What I’ve noticed is the pickaxe setting does seem to be respected on repeat plays, but never on the first time island is played on a new server.