I’m currently testing OpenXR OBS Mirror ( elliotttate’s github ) with MSFS 2024 and Virtual Desktop with my Quest 3, The only issue I am currently trying to solve is the interaction between OpenXR OBS Mirror and OpenKneeboard.
OpenXR OBS Mirror works correctly on OBS capture when MSFS is the only OpenXR composition being mirrored (even with openxr toolkit being visible). However, when I enable OpenKneeboard and place it over the MSFS view, OpenKneeboard itself works perfectly in the headset, but the OBS output becomes completely black and I can see some flashes of the kneeboard trying to be displayed. ( youtube video link ). The important point is that the VR headset continues to display everything correctly: MSFS and OpenKneeboard are both visible and working normally in VR, while the OBS mirror output becomes black. If I remove or disable OpenKneeboard, the OBS mirror immediately works again.
The OpenXR OBS Mirror log contains the message “Recording OpenXR quad layers: included.” Since OpenKneeboard uses an OpenXR composition layer, I suspect the problem may be related to how OBS Mirror handles the combination of the MSFS projection layer, the OpenKneeboard quad layer, the VirtualDesktopXR compositor, and the OBS Mirror API layer. It seems that the headset compositor can correctly compose these layers, but OBS Mirror cannot reproduce the resulting image when the OpenKneeboard layer is present. Again, OpenxrToolkit can be visible in those layers. With OpenXR-API-Layers-GUI.exe I already tested all combination as possible in the order but with no success.
This is particularly interesting because when I was using Meta Link and Oculus Mirror, I could have the MSFS projection and OpenKneeboard overlay together and Oculus Mirror would correctly show the complete result in OBS. With the OpenXR OBS Mirror setup, however, adding OpenKneeboard causes the OBS output to become completely black. This makes me wonder whether Oculus Mirror was capturing the already-composited compositor output, while OpenXR OBS Mirror needs to reconstruct or intercept the individual OpenXR composition layers.
Anyone with more skills can let me know if you can use OpenXR OBS Mirror and OpenKneeboard layer at the same time with OBS?
the image below => Oculus Mirror + OBS + Openkeeboard
the image below => OpenXR OBS Mirror + OBS + Openkeeboard Opened
