Turns out the above will not work when the GameplayEffect is part of a ‘Cost’ for a GameplayAbility. Even though the modifier is executed, it does not seem to be picked up by the ‘CheckCost()’ function.
Meaning if you’re using an execution to manually create modifiers, abilities can be executed even when they do not meet the cost requirements. I’m a bit lost.