If you are on Chrome, you can use this extension for an alternate player which allows you to select an audio-only stream. Less bandwidth than the 160p video, and full-quality audio.
Alternate Player for Twitch.tv - Chrome Web Store.
It was suggested by Coppersens a while back and it is incredible! Without it I couldn’t listen to the stream and fly at the same time.