Check the dependencies and remove them before deleting. Right click on the file and check the references viewer.
Another way is to delete the $project/Content/directory from windows.This method may break your project.