Starting a new job or role often means facing a gap between what you’ve learned and what real-world experience demandsA newly licensed real estate agent might know the material but has never sat across from an actual client, and that first deal can be daunting. Or maybe a new manager is about to fire someone for the first time. What if you could practice those high-stakes moments before they happen?

Virtual reality and AI are now making it possible, turning knowledge into confidence through realistic, judgment-free training. “I can’t imagine having to fire somebody for the first time and never having done that. It’s probably terrifying, emotional, and scary in a million different ways,” said Jack Makhlouf, VP of partnerships at Moth+Flame.

“We try to build simulations for people so they can get a lot of practice. It’s also safe to fail. One of the secret powers of simulations is that you can mess up,” he said.

Makhlouf spoke about the advantages of VR and immersive learning with Joe Reta, a partner manager at ArborXR and collaborator with Moth+Flame, during a thought leadership spotlight at From Day One’s Dallas conference. 

Immersive training has been around for a while. Think flight simulators, for example—something the military and airline industry has used for years. The benefit of this technology, says Makhlouf, is that “you’re physically doing something.” 

“You’re emotionally engaged in the experience. It’s interactive. It’s multi-sensory. You’re looking. You’re talking. You’re using your hands. It’s very realistic.” And, there are no real world consequences for making mistakes. “You can say the wrong thing and suffer the consequences. But you’re in a judgment free experience, so you’re safe to mess around,” Makhlouf said. 

AI immersive learning has only become more intuitive and dynamic. Makhlouf calls it the perfect learning tool. “If I mess up in a giving feedback conversation, I’m going to know why and I’ll get to try again, and it’s going to assess me on tone delivery. It’s pretty advanced that way.”

The military knows this and has long been a proving ground for the highest level of simulation-based training because they have “to keep their service members ready at all times,” Makhlouf said. It has also proven valuable in hands-on mechanical training. Makhlouf highlighted a program developed for the Air Force, which trains personnel on the precise steps needed to power up a C-17 cargo aircraft. Before using virtual reality, trainees learned through PowerPoint which led to costly mistakes in the field. “VR is a really great place to practice and fail,” he said. Thanks to immersive training, the Air Force cut errors by 85% and saved an estimated $1.7 million in fuel costs, says Makhlouf.

While the upfront investment is significant, Makhlouf says that the ROI makes it worthwhile. “You’ve got to look at the return,” he said. Circling back to difficult conversations in the corporate space, Makhlouf says that both a popular and personal favorite module is in feedback. “Everybody thinks they're good at giving feedback, even positive feedback. But people don't know how to give proper positive feedback.”

Building trust is another one. “We know that the relationship between [the] employee and their direct manager has a big impact on engagement. How do you build trust? How do you resolve conflict? How do you increase your emotional intelligence?”

The big advantage immersive AI learning has in achieving better results in training, according to Makhlouf, is that people are using their voices, “not clicking answers in a scenario.” 

“Ironically, the first simulation I ever tried in my previous company was a firing simulation in VR. You’re sitting across the desk from an older guy who’s been inappropriate, and you got to call him in for a one on one, and it's the last straw. It can end badly, and it does end badly if you don't do it right. It can also end really well,” he said. He says they had people crying coming out of the simulation because it was so real.

That is how this training is supposed to work, and why it feels so real; it’s immersive. “It is voice driven, whether you’re doing it in VR or tablet or mobile. You're navigating a conversation. You’re getting feedback on the fly—these avatars and actors are talking back to you. You’re in a conversation; it can go well, or it can not go so well. It’s completely up to you.”

Wellstar Health System, a client Makhlouf’s company worked with, wanted to boost empathy among staff, so Makhlouf’s team created a simulation where participants’ answers were scored based on their level of empathy, prompting trial and error until they improved. “The first time through, people don’t get 80% or 100%,” he said. But with practice and targeted feedback on skills like empathetic paraphrasing, employees saw steady gains, much like building strength through repeated reps at the gym.

What makes immersive training so effective, especially in a VR environment, is the combination of evolving technology and AI, and the fact that the AI avatars are based on real world actors. “So there’s not just some conceptual human prototype being used for AI avatars. They’re people...AI is mimicking facial expressions, their voice, body language and all that. They’re getting scary good.”

Makhlouf's advice for companies and HR departments that want to modernize their training modules with immersion learning? “I would not recommend building something custom right off the bat. I would recommend you pilot with content that’s already made, and there’s a lot of content out in the field that’s ready to go off the shelf. So find a piece of content that aligns to your use case or business goal. Pilot it out, prove it out, build your business case. VR or immersive really shines when the use case is very, very strong.”

Editor's note: From Day One thanks our partner, ArborXR, for sponsoring this thought leadership spotlight. 

Matthew Koehler is a freelance journalist and licensed real-estate agent based in Washington, DC. His work has appeared in the Washington Post, Greater Greater Washington, The Southwester, and Walking Cinema, among others.

(Photos by Steve Bither for From Day One)