As far as pointers are UObject types and created/spawned via NewUObject/SpawnActor everything will be handled automatically. AFAIK UObjects also work fine with “new”.
You’ll need destructors for classes which are not derived from UObject, assuming there’s actually something to destroy.