If you have references to those files still existing in the project, it could cause some issues, I recommend making sure you’ve removed all references to the assets that you’ve deleted.
Also, I recommend checking your logs to see if there are any errors coming up while your packaging.