Next-level radar training with AR and VR
Virtual and augmented reality have grown beyond mere gimmicks for consumer gaming. They鈥檝e become useful tools for designing, test-driving, maintaining and even operating industrial systems. At Thales, Jeroen van der Wel is digitally recreating radars down to the nuts and bolts.
鈥淥ur team is developing very specific VR and AR applications. Not the commercial stuff, but solutions tailored to our needs and the needs of our customers,鈥 says Jeroen van der Wel, head of XR innovations at Thales. 鈥淲e鈥檝e been doing this for five years now, guided in part by my experience in the field. I started at Thales as a system test engineer, stationed at customers in Asia, and after managing the development of test, training and simulation equipment for a couple of years, I became responsible for the creation of innovative product concepts, mainly related to the service domain. I鈥檓 still doing that, but now with a strong focus on XR 鈥 extended reality.鈥
Virtual reality
Van der Wel sees opportunities for XR in system design, training, maintenance and operations. 鈥淎s part of several projects, we鈥檙e creating complete command decks in virtual reality,鈥 he gives as an example. 鈥淐ommanders can 鈥榳alk around鈥 in there and review whether everything鈥檚 in the right place 鈥 the equipment, the consoles, even the lights and their reflection in the monitors. They can sit down in their chair and check if they have an unobstructed view of all their crew. Based on their feedback, we can easily tune the design before actually building it.鈥
For training purposes, Van der Wel and his team have digitally recreated entire radar systems. 鈥淲e鈥檝e built several radars in VR, down to the nuts and bolts. With the push of a button, we can reveal the inner workings 鈥 the level of detail is unprecedented.鈥
The digital recreations provide a training alternative that adds a lot of value. 鈥淎 big challenge for our customers is that their radars are often unavailable, for example when their ships are on a mission. You don鈥檛 usually buy a spare one just for training 鈥 they鈥檙e not cheap,鈥 explains Van der Wel. 鈥淥ur VR models are cheaper than the real thing and allow you to do things that you definitely wouldn鈥檛 want to do with an expensive high-tech system, like cutting the power over and over again and implementing errors for the trainees to find. Another big advantage nowadays is that they鈥檙e ideally suited for corona-proof training.鈥
Augmented reality
To streamline system maintenance, Thales is using AR. 鈥淚t can be very confusing to find the right valve on a ship,鈥 illustrates Van der Wel. 鈥淲ith an AR headset, it鈥檚 a piece of cake. We can put a virtual icon on the target valve, along with some arrows showing the direction to open or close it. There鈥檚 a host of system data we can project in this way.鈥
When to augment reality and when to virtualize it is a careful consideration, Van der Wel emphasizes. 鈥淎ll too often, I see people who are really adamant on using a specificAR device. They just have to have it. And then they build an application where you don鈥檛 actually need to see the surroundings, and so virtual reality might be the best way to go. The Hololens, for example, is a really great tool for a lot of AR experiences, but when you need an extra-large field of view or very-high-resolution models, there are plenty more great VR headsets to choose from, such as the Varjo 鈥 it pays to do your research.鈥
Memory palace
To be sure that VR is really an added value to the current training curriculum, the team is researching if people can learn better in virtual reality, since training in VR includes using your spatial memory. 鈥淗ere, we went deep in the inner workings of the human brain and looked at how memory works. We鈥檝e tested our hypotheses with the University of Twente and proved that the VR training we developed performed significantly better than the traditional classroom trainings. You can see the VR training as a memory palace. People that are using memory palace techniques are very skilled users who can remember insane amounts of data. But rather than having to create the memory palace in your head yourself, in this case the full system, we do it for you in VR.鈥
Within Thales, Van der Wel sees several forms of extended reality gaining strong traction. 鈥淭he possibilities of XR are very promising, and our team is translating this into real applications. We鈥檙e looking forward to our customers鈥 reactions!鈥
Want to learn more about what it feels like to work at Thales? Looking for a job at a true high-tech company in the Netherlands?