Need help with IK for fingers

I’m trying to create an IK for my fingers in my control rig. I can’t get it to work. Fabrik sorta works, but the joints bend the wrong way and look terrible. Same goes for all other solvers, they all look bad. I believe the 3 bone ik is the one I should use, since it has a vector to help with the correct bending, but nothing I do works. I’ve been fiddling with it all day, this is the closest I got.

I’m using the skeleton mesh from the Oculus VR github:

https://github.com/Oculus-VR/UnrealEngine/tree/oculus-5.1/Samples/Oculus/HandSample/Content/Hands

Here is how I’ve setup the node. I have a control for the pole vector and one for the index finger pad. Any help is appreciated.