Having Issues with Displacments on My mesh

I’m trying to apply a displacement map onto my character but I can’t seem to get the right node setup for this to work.
I’ve tried a few setups but either the mesh turns pure black or it swells up. Sometimes I spot light artifacts as a result of the displacment as well.

I’m using Virtual Texture nodes so can utilize UDIMS- not sure if that makes a difference, but thought I mention it.