Lots of .pdb and .dll files under Binaries/Win64

So it is normal that all those files with numbers are generated each time i make a change in code?
That is pretty weird as they disappear when i remove the binary folder manually and recompile it. Why are they generated in the first place then and is there a way to turn that off?