Keyboard/mouse unavailable after reconnect

I am using a KVM switch built into the monitor to switch between private and work systems, so this becomes really obvious when I want to do something like download an update or just try something in a few minutes of downtime. It also means I can’t really enable display power saving since that will eventually force a switch to whatever other input on the monitor is active.