I'm a beginner of ue5, and I dont know how to fix this problem with publishing on steamworks SDK.

This is a different thing, it’s a packaging error. You need to package separately, then upload to Steam.