Answering my own question here if anyone else is having similar issues.
I ended up using a different hand model that is similar to what is shown in the documentation with an arm and forearm bones. After doing that and setting arm and forearm bones correctly it worked.