Create single fibers for Texture

Hello,

I’m trying to add like little ‘imperfections’ to my textile texture.

In the medieval Game made from Quixel they had this texture, where you see like the little fibers sticking out from different parts.

How do I go about creating these type of textures.
I tried to cut the mesh in blender or adding an alpha channel with holes in the mesh, but nothing really comes close.