I tried Game mode and still had the dimming issue. I saw one user online suggested turning down the OLED light to 35. I had it at 100, this did help a lot. It still dims, but now only slightly. With other adjustments (to bring up the overall levels) I have it just about where I want it. No more distracting dimming.
Thanks for the suggestions!