So today I tried to better understand Git-LFS and managed to manually redownload the files from LFS. This fixed the issue although I still do not understand why it was so ■■■■ complicated to restore LFS files.
The issues was that me discarding changes in Git did replace the files with pointer files and thus made them look “corrupt”.
I guess this is the result of a bad git lfs config.