Just to follow up… if you have C++ header-only library that you want to drop in to your game project then easiest way is to create folder Source > ThirdPary > MyHeaderOnlyLib > includes and then drop all your files in there. You can then include these files in UE4 C++ code as usual:
#include "ThirdParty/MyHeaderOnlyLib/include/MyLib.hpp"