An alternative is to use the co-pilot to handle ATC responses, as they are mostly only confirming a directive, changing frequency, or sighting traffic.
I don’t switch the assist on until I have taxied to the runway (to avoid getting an early pushback), and the co-pilot seems to go to sleep once you have left the runway at your destination, so this works well for me.