Found the solution. Was pretty simple. The “Enable HMD” only works in packaged builds or when running in standalone.
Since it was a simple feature I was previously testing in viewport.
Maybe this can save someone else some time who is also struggeling with this.