NASA Logo, National Aeronautics and Space Administration

+NASA Home

+Ames Home

Autonomous Systems and Operations Project to Deliver Augmented Reality Demonstration Software to ISS at the end of March
Intelligent Systems Division Banner

Autonomous Systems and Operations Project to Deliver Augmented Reality Demonstration Software to ISS at the end of March

The Autonomous Systems and Operations (ASO) project will deliver the final version of the T2 Augmented Reality (T2AR) demonstration software, an International Space Station (ISS) payload, to the ISS Program at the end of March. In T2AR, ISS astronauts will demonstrate the ability to perform maintenance and inspection activities using augmented reality hardware and software. Specifically, the ISS crew will perform monthly and quarterly inspections on the T2 Treadmill onboard ISS using applications developed for the Sidekick device (a Microsoft Hololens). The applications will track the crew's progress through the procedure, highlight parts of the T2 Treadmill to be worked on during specific procedural steps, and provide visual cues to assist the crew with each step. The applications also respond to voice and gestures made in the field of view of the Sidekick device camera. The demonstration will evaluate the crew's ability to perform these inspections faster and with less reliance on ground-based support. Dr. Jeremy Frank gave an overview of the payload as part of the ISS Increment 59-60 Science Symposium in February. The demonstration is expected to take place this summer during Increment 60.

BACKGROUND: For over 50 years, NASA's crewed missions have been confined to the Earth-Moon system, where speed-of-light communications delays between crew and ground are practically nonexistent. This ground-centered mode of operations, with a large, ground-based support team, is not sustainable for NASA’s future human exploration missions to Mars. Future astronauts will need smarter tools employing Artificial Intelligence (AI) techniques to make decisions without inefficient communication back and forth with ground-based mission control. The overview presentation of the T2AR payload software describes several demonstrations of astronaut decision-support tools using AI techniques as a foundation. These demonstrations show that astronaut tasks ranging from living and working to piloting can benefit from AI technology development.

NASA PROGRAM FUNDING: Human Exploration Operations Mission Directorate (HEOMD)

TEAM: Jeremy Frank and Chris Knight; JSC: Danielle Conly, Iona Gipson, Truyen Le, Jeffery Mauldin, Kerry McGuire, Jeff Rosenthal, Victoria Rosenthal, and Lui Wang


First Gov logo
NASA Logo -