We’ve removed the SteamVR plugin in 5.3 and it’s not recommended to continue to use it as there will be no bug fixes or feature development for it. You won’t be able to update engine versions if you use the SteamVR plugin.
This does seem to be an issue w. the SteamVR OpenXR runtime if the same issue is present in other games (particularly if they’re not made with UE, like Beat Saber).