You can actually delete the arm and weapon. Just make sure to delete the referenced blueprints and the key bindings, leaving just the moveforward, moveright, lookuprate and turnrate.
Other way around is just to make a character blueprint and add a camera to it, copy the movement input and set key bindings.