Hi everyone,
I had this same issue with very similar blueprints. ItsLightsaber09’s solution above was correct, though mine was a bit different: I set my “Set Collision Enabled” for my grab to “Physics Only”. For each object that can be picked up, as the OP said, set the collisions to custom and disable pawn collisions.
Working great for me now.