Okay, so after tinkering with this a lot, I have figured out the issue.
Apparently, different ROTATIONS of the Capsule Component affect how it interacts with the cloth. Check out the following video to see how rotation affects it:
Capsule Component — Rotation Issue
Any idea what would be a good fix for this?