I think you can make plugin without any code, so it would be just assets.
Also if you make subfolder in Content, put all assets in there. You can zipp that subfolder, unpack it in another project and you will have all copied there.
Unreal does not mind moving assets that do not reference other assets outside what you are moving. So be careful with referencing in package and you will be safe.