Do I have to pay for using UE4 when I am not selling my UE4 work but advertising other products through it?

That would still be royalty free based on your description.