This is definitely broken in 4.24 and 4.24.1
I believe it’s related to this fix somehow breaking it. UE-81956
Also relevant: https://github.com/EpicGames/UnrealEngine/commit/47cce1fa087bc5faee0655b2fe29b3086e83d815
I tried editing my engine source to revert that change and still no luck, so I believe it happened elsewhere but I could be wrong.
I am able to reproduce this bug in a brand new project as well.