Using Voice Commands to control Aircraft

I haven’t seen many discussions regarding using voice commands and I thought I would share with the Community the capabilities that many may not know are currently available.

I am using; the Program VoiceAttack. I am in no way affiliated with them.

To start with I just want to say that I really love having the ability to control most of the aircraft functions just with voice commands. I mostly fly the Kodiak 100 and Cessna 172. The Kodiak 100 has fairly advanced avionics and having the voice commands makes the aircraft technology seem cutting edge.

I wanted to give you some examples of what is possible.

I fly IFR most of the time. I also have vision issues and finding frequencies on charts is a bit of a challenge. So for the area where I fly, I have voice commands to give me frequencies. For example, I say “John Wayne” and then it speaks the frequencies back to me. I have programmed it to read Tower frequency is XXXX, Ground control frequency XXXX, Atis frequency, SoCal Departure, ILS 20R frequency is XXXX

Of course I could make the list shorter or longer.
For VOR’s , I just say the name of the VOR and the Voiceattack program will read me the frequency. So I say “Seal Beach” and then I hear in my headphones "Seal Beach VOR frequendcy is xxxx.
So I have this set up for the most frequent airports that I fly in and out of. Usually if I fly anywhere new I will go ahead and program the information I want to retrieve.

Autopilot Functions. Almost all of the autompilot functions can be run off voice commands. Autopilot on, autopilot off, heading on, heading off, vertical speed on and off, altitude hold on and off.

For the 172, I can use voice commands for most but not all of the functions.

So a typical sequence in the 172. I usually fly at night so when I spawn into the plane it is pitch black.
So first voice command is “flashlight” and the flashlight comes on.
All of my camera views are programmed so I can name the camera views or just memorize the numbers. So I can say “view 1, view 2, view 3” etc and it will switch to that camera view. I can then say right, left, up and down to move the view.

Next, Mixture Rich. For something like this you could use multiple commands. Saying mixture rich would first run the command to turn the camera view right on the mixture knob. - so you could physically see it move to the rich position. You could then put a 5 second pause where you have seen the mixture knob go to Rich, and then it sends the camera view back to view one.
Another option is to not move the camera at all - but after saying “mixture rich” you hear a voice saying “mixture rich” . The computer voice can be several voices.
It could of course be programmed to say anything.

other voice commands
Fuel Pump ON. and off
Flaps, flaps increase, flaps decrease, dump flaps

Altitude UP 100, 200, 300, 400, 500, 600, 700, 800, 900, 1000, 2000, 3000, 4000,. 5000, 6000, 7000, 8000, 9000

I haven’t programmed above 9000 but it could easily be done. Of course I have also programmed altitude down. So if ATC tells me to climb another 2000 feet. I just have to say “altitude up 2000”, then “Vertical speed on”, then “nose up 600”

So I have the nose up and nose down programmed up to 900 feet in 100 foot increments. Flying an ILS approach without using autopilot (or without the Approach mode armed), you can easily adjust the vertical speed by just saying saying nose up 100 or nose down 100 and it is a pretty easy way to keep the glideslope

The Throttle is also programmed for the following voice commands
cut throttle, 10%, 20%, 30%, 40%, 50%, 60%, 70%, 80%, 90%, fully throttle, increase throttle, decrease throttle

So on an approach when you have the airport made, you just say “cut throttle” and it comes back with “throttle cut” in the headphones.

sorry this is so long

I have been able to program the heading bug with the following voice commands "heading up, heading down, heading up 2, heading up 3, heading up 4, heading up 5, heading up 10, 20, 30, 40, 50, 60,70,80, 90, 180. And of course heading down is the same. Flying using the autopilot on heading mode - it is easy to make small adjustments by just saying “heading up 4” .

I just realized I could use this to program a timer. I haven’t done that yet because I just thought of it but it would be easy to program. So if you are flying a holding pattern you could say “one minute timer” and after one minute the computer would say “timer is expired”

For IFR flying, I am using pilotedge - which is an actual human being serving as controller. So using pilotedge you have to use the radio exactly as you would in the real world. So for an IFR flight there is going to be clearance delivery, ground control, tower, departure frequency and future frequencies as you get handed off to the next facility. So I have a Text document open on the computer (you could use anything, word or a wordpad app). If I get a call from ATC - as soon as I hear my number, I say “wordpad” and the computer does an Alt Tab and jumps to the notepad that I already have open. I am now ready to type using the keyboard and copy what ATC is saying. So the notepad command is very useful when IFR and allowing you to quickly write down and copy the next instruction.

There are lots of other miscellaneous items and I will probably leave off a bunch
ignition start, parking brake on and off, pitot heat on and off, landing lights on and off, drone view, drone increase hight, drone decrease height, drone left, drone right., flight director on and off.

I’m sure I’m missing a bunch but the point is if you can keybind it, you can turn it into a voice command. The things I have been unable to do are things like VNV mode on the autopilot. I can’t figure out a keybind for VNV on the keyboard so I have been unable to figure out who to do it with a voice command. But even for things that cannot be turned into a voice command, the voice command can still be useful. For example, when flying the piper arrow, the tanks must be switched and you are either on the left or the right. So every 30-45 minutes, I need to switch tanks. I decided for this one not to use a voice command to switch the tanks. Instead this is what happens. I say “switch tanks” and that starts a series of commands. The first thing that happens is the camera view switches to the floor where the fuel switch is located. It next turns on the flashlight because the floor of the plane is dark. Thats it. Thats the end. You then just take your mouse and switch it normally. But the voice command got the flashlight on and had you pointed where you need to be pointed. You can then say “view one” to take you back to the previous view.

I have been unable to program the radios to go to a specific frequency although I heard that it is possible to do so. People smarter than I am have figured that out.

OK, I have made this way to long.
I am by no means an expert in this but have flown 500 hours with this and keep refininig it.

I would be happy to answer any questions or share the commands I used with the voice attack system for anything I have programmed.

I am (was) a real world pilot. I was in the Airforce but was not a pilot. I am so grateful that this sim exist. I’m 62 and having some vision issues but I can zoom right into the PFD for the IFR stuff so I so grateful to have such an amazing program. I hope to someday try the VR. And although this might be thought of as a great solution for individuals like me with vision issues or those that have other disabilities - I have to tell you that I would be using this if I was completely healthy. To me having a Siri like interface to control the aircraft just seems like a logical next step.

For me, this added to the immersion of flying. It also is kind of a star trek feel to it. You are literally giving commands and the aircraft is responding. It feels like you have a copilot. I feel like I am more connected to the experience. The headphones become more useful. Instead of just hearing the engines - you can talk to the plane.

I have no idea why I made this so long. I think I realized that very few people talk about this but I know I’m not the only one using this. I just thought there might be some people that are just not aware that this is a possibility.

By the way the Voice attack program itself was inexpensive. I think it is less than $15. It might even have been $10 when I bought it. Again, I am not associated with them but it is a great program . I might not be able to fly any longer IRL but I have found the fuel to be a lot cheaper in the sim. 500 hours of flying some of the best aircraft in the world. I can’t imagine how much it would cost in real dollars to fly that much.
Thanks everyone for listening to me rant. I’m in the middle of a snow storm but will be flying all day tomorrow. Thanks to everyone in this community for making this such a great place!

9 Likes

Fascinating read, I have voice attack but not used it to do what you have done.

I use VR and think it would be really advantageous for me to use VA a bit more.

It seems like you’ve spent many good hours programming it, I bet some people would love a copy of your profile even for a small fee to pay for some coffee.

I too am in my 60s and love flying in the sim, save up and buy yourself a VR headset.

1 Like

I’m glad you’re enjoying VA. I used it for awhile, but decided against it because it broke the immersion to speak commands. Yeah, I know, using a keyboard and mouse isn’t exactly soaking up the immersion either, but the voice commands just seemed odd to me.

But more power to you, I’m sure there are many others here who would love to try it.

1 Like

I use Voice Attack in VR but I haven’t taken it to the level you have. I’ve only set some pretty simple commands but your post has me wanting to go add some more complex ones. Thx for the share!

Hi Bud91341, thanks for this. I have Voice Attack and always have trouble assigning things. Any chance of a copy of your profile, if not, how did you programme it to speak back the frequencies to you? Do you have to list each airport by name or can you make it generic? Thanks in advance.

Bud,

Thanks for the post, I really appreciate it. I’ve tried using a Voice Attack profile made by Virtual Voyager, called Immersive Aviation, and it seems quite good, but it requires a mod to be added to the community folder. This mod locks in the incremental increase/decrease of dials for air speed, altitude, and vertical speed, so you can say “Increase altitude 100 feet”, etc.

The problem with this is that the mod has to be updated for every new MSFS update to individual aircraft, and will not work with third-party aircraft mods unless you edit each aircraft config file. So, it gets out of date every time an aircraft mod update is released.

How did you program these commands so that you avoided this?

Thanks for the lengthy post. I, for one, would love a copy of your profile, if you are willing to share it.

Best regards,
Bill (another senior simmer!)

FS2Crew allows this, it has voice recognition so you can speak to your “first officer” to do the things you want them to do. But so far I only got it working on FBW A32NX and Headwind A330-900neo aircrafts. I don’t fly other aircrafts, so I’m not sure how it behaves on them.

Great to read and hear about your experiences with VoiceAttack.

Do check out the free VA plugin called MSFSAgent developed by James Clark that is available on GitHub. It doesn’t use key binds but SimConnect. This is in my opinion the best plugin for VA.

Among other great functions, It allows the change of COM and NAV frequencies through voice. Also you can add your own customization pretty easily by following the MSFS Event IDs document. Setting of HDG degrees, Vertical Speed fpm, and also set altitudes directly.

Some of the functions I have added are monitoring of V speeds and calling out “air speed alive”, “V1” and “rotate”. This will be followed posyuve rate and by automatic gear up, flaps up throttle to climb and YD etc.

Another cool function that I have added is Missed Approach. During this time critical event, all the required commands are automatically executed. Ex. Full throttle, flaps to takeoff, setting VS, activating AP and contacting SIM ATC etc.

The possibilities are endless.

Here’s the link:

Regards,
Athena
(another senior simmer)

2 Likes

There is a software designed years ago for FSX, P3D, X-Plane and now MSFS (for the same price, i.e. covering all the above with one purchase) called Multi Crew Experience (MCE in short).

Beside the existing numerous planes already interfaced, you can interact with ground and cabin crew, but more importantly with ATC, and with your copilot whom you can give instructions to and cover check-lists as well as work-flows.

It is a one time purchase, the support is great and friendly, and you can get free updates for additional add-ons as and when they are released. I have been using it with all the above simulators and can highly recommend it.

You can also try the software for free and with a minimum voice training get it to work for you.

1 Like

I’m surprised that nobody has mentioned the excellent ‘Aviator’ packs from HCS Voicepacks. These are really well developed and make an excellent co-pilot. They’re also currently on sale!
HCS Voicepacks

Hi Bud,

would you mind to share your profile? Iam using it for years,
but couldn’t get it working for frequencies.Your help would be much appreciated.

Scott

I do have and like HCS and although it works on default aircraft out of the box, it doesn’t provide for user customization and addition of profiles; it’s locked. And there’s no comprehensive documentation available for the full list of available voice commands. But I do read that things will develop later as it is now on Beta.

MSFSAgent provides most of the functionality that is currently available in HCS with the added feature of free user customization and also the possibility of using additional voices like Amazon Polly or Microsoft Azure.

1 Like

What a fantastic post. Thank you for sharing!

Hi Athena, it sounds really interesting. Thanks :slight_smile:

May I ask whether this plugin still is relevant for you?

Or if you have maybe found something else similar that work with VA.

Cheers
Carlos

Axis and Ohs also allows voice control.

I mainly fly the DC-3, C-160, and the Caribou. All crewed aircraft. Not having at least a co-pilot to help manage the cockpit is, for me, an immersion-killer. I’ve used Voice Attack to read off checklists, with a few commands to raise gear and adjust flaps, for example. I say, “gear up” and get a crisp “Roger, gear up” from VA and up comes the gear. Really adds to the immersion.