Ah right, I forgot to enable PDB downloads on the engine binaries.
Anyways, turns out the issue in my case is I was loading a fallback blueprint class via ConstructorHelpers::FClassFinder just in case someone entered a bad value in a json file for a character definition. Easy enough fix here.
Thanks for the advice!