Hello there @9Evgeny9!
The short answer would be, if you want to avoid recompiling your project entirely from the backup, then yes, you will need to keep the contents of Binaries and Intermediate folders. Deleting them will enforce a compile the next time you try to open the project.
The elements that are not needed for run, or need to be recompiled, are mostly elements from folders Saved, DerivedDataCache, and StagedBuilds. You could also delete .vs and build, but these ones wil be re-created on first run.