Yes it was really the issue, this feature is not yet implemented! With the help of the pull request above I was able to get montages for slots that are present in linked anim layers working.
In case anyone reads this please give a thumbs in https://github.com/EpicGames/UnrealEngine/pull/9316. I try now to get this feature into UE5. 