Yeah, usually I can just glance down there. (Gotta pick one eye or the other though!) 
I fly IRL and it feels very natural. Same pen, same pad, same lap & yoke. Heck, I have a yoke mounted iPad and don’t mind lifting my goggles every now and then to look at the map, and to interact with ForeFlight, which functions exactly are it does IRL.