I found the problem. Turns out that the steamworks sdk version was out of date. I would recommend trying to fix that if you have the same issue like me. You can update it to the latest version by going into the epic games launcher, clicking the arrow next to the Unreal Engine version you are using, then select Verify.