How to create a const TweakObjectPtr<UObject>

I think you meant TWeakObjectPtr<const UObject> here? Your version would be a const weak pointer to a mutable object, which doesn’t make too much sense when starting from a pointer to a const object.