It’s not just you. Both my Rift CV1 and Quest 2 do this too when using the steamVR version of the openXR runtime. It’s some kind of incompatibility or bug between the Oculus host and the steamVR openXR runtime. It’s not likely to be something you can fix, as it’s bugged at the level of the openXR compatibility – the SteamVR devs, and specifically the ones working on their openXR support, would be the folks to fix it.
That said, just curious why you’re so set on using the steamVR openXR runtime instead of the Oculus one…?