How to read the com port data in ue4?

Same way you would in any other C++ program.

For example: GitHub - wjwwood/serial: Cross-platform, Serial Port library written in C++

If you want information on linking to the external library from your project, see this question: https://answers.unrealengine.com/questions/197667/how-do-you-statically-link-an-external-dlldylib-to.html