How can I smooth my mask edges? Thanks.

you could try adding a dithertemporalAA node between the alpha and opacity mask.

the opacity mask takes in a 0 or 1 value. you will need to switch from masked to translucent material and use opacity input to get a gradient.

thanks a lot, this helps