I would use a physical material, in the CanObjectBeClimbed function you can check the physics material surface type of the object for whatever you want and allow / disallow climbing based on that.
IE: Allow climbing on wood / metal, disallow on glass, or however you want to set it up.
If you literally wanted it to be based on something like “only climb on the color green”, you’d have to get more involved.