By Nick Wakeman
Mar 12, 2021
The Defense Advanced Research Projects Agency wants to explore how artificial intelligence-enabled assistants can provide guidance in the form of just-in-time visual and audio feedback to help users expand their skillsets and minimize errors or mistakes.
In the Perceptually-enabled Task Guidance (PTG) program, humans would wear microphones sensors, head-mounted cameras and an augmented reality headset that all send and receive data. The system could help medics or mechanics, for example, by understanding what they’re working on and offering AR-based instructions to help them perform complex tasks.
“These sensor platforms generate tons of data around what the user is seeing and hearing, while AR headsets provide feedback mechanisms to display and share information or instructions,” said Bruce Draper, a program manager in DARPA’s Information Innovation Office. “Developing virtual assistants that can provide substantial aid to human user