If you want to get rid of the entire class, you’ll have to delete the files outside of Visual Studio. With the way UE4 sets up solutions, using Visual Studio’s “remove” file from project simply removes it from the solution, but UBT will still attempt to compile it because it still exists within the project’s source.
However, do note that any blueprints you may have created with that class as a base will most likely not work.