Can I publish my game made with UE4 as open source game?

Yes, as long as you don’t also copy in any assets or source code that is copyrighted by someone else (such as EPIC.)