How can I set SkeletalMeshComponent to be the true dealer of character collisions?

I was thinking of just starting from the pawn class and adding my own control code for the character to move around.