It’s best to create the masks in another image/psd and then copy + paste in place in a new document, in the respective channel (red, green, blue). Make sure the new document has a black background and that the mask you are copying from the original is filled with white. You can then use each channel as an individual mask in the material editor.