Honestly if you choose to ignore the framework then fine, but you’ll be in an uphill struggle all the way. A lot of core functionality won’t behave without it and you’ll run into mishaps later down the line. If want to use any of the navigation or AI features for example, and you don’t use a pawn with a PawnMovementComponent - good luck with that.
There’s a lot to be said for using the tools in the way they are designed.