I found out that the error is thrown by .\Engine\Binaries\DotNET\GitDependencies\win-x64\GitDependencies.exe which accepts has a parameter called --max-retries=<N>. I passed the --max-retries value to .\Setup.bat, which passes it to GitDependencies.exe and the process did finish this time.