I think I know what my issue is. Calling Get() on my SoftObjectPtr Reference gives back a const ref of referred object. Since const ref is not the same as using this pointer from within my actor class, my code thinks that this is not the same object in the level.
const ref cannot be compared to this pointer, since this pointers aren’t const!