Integrated Visual Augmentation System | |
---|---|
Type | Augmented reality headset |
Place of origin | United States |
Production history | |
Designer | Microsoft |
Designed | 2018 |
Specifications | |
Weight | 3.4 lb (1.5 kg) |
The Integrated Visual Augmentation System (IVAS) is an augmented reality headset being developed by Microsoft for the United States Army. It intends to improve situation awareness by overlaying sensor imagery and other information on the soldier's field of view. Originally developed for infantry, it is also being adapted for use by mounted soldiers and aircrew.
Its development was initiated in 2018 and is currently undergoing testing. The process has been marked by numerous problems which repeatedly delayed its deployment in the field. Despite incremental improvements, reception of IVAS has generally remained negative.
Design
IVAS is an augmented reality system based on the Microsoft Hololens 2 headset.[1] It intends to provide soldiers with "improved situational awareness, target engagement, and informed decision-making".[2]
The system consists of a display, a computer known as a "puck", a networked data radio, and three conformal batteries. The display can augment the soldier's vision with imagery from thermal imaging and low-light imaging sensors. The radio allows data from the soldiers' individual IVAS headsets to be passed among members of the company.[3]
The latest version of IVAS, version 1.2, weighs 3.4 pounds (1.5 kg), although developers are working to reduce this to the target weight of 2.9 pounds (1.3 kg). The computer is attached to the back of the helmet to distribute weight and move the center of mass. The display has a field of view of 60 degrees, using a flat display that can be flipped upwards.[4]
Software installed in the computer allows IVAS to perform many functions. Version 1.2 introduced an embedded training tool known as the "Squad Immersive Virtual Trainer", a piece of software that can project holographic and mixed reality imagery via the IVAS headset to help train soldiers in combat.[5] Navigation applications can display maps of terrain and interiors of buildings, and show the positions of friendly and enemy forces. New kinds of software can also be developed and uploaded to expand IVAS's capabilities; examples include designating fields of fire for machine gunners, generating medivac reports, and conducting field surgery assisted by augmented reality.[6]
In March 2021, the U.S. Army announced that IVAS was being tested with mounted soldiers, such as on Bradley Fighting Vehicle and Stryker teams.[7] By June 2021, the US Army announced it was expanding IVAS tests to include aircrews for helicopters and drones.[8] In comparison to the $400,000 purely-slaved and aircraft-dependent F-35 helmet that must be custom-built for each pilot,[9] IVAS attached to any helmet, was estimated to cost $29,205 per unit, and could optionally work independent of the aircraft when the crew dismounts.[10]
Development
Although it is unknown when the idea for IVAS was first conceived, the Army Acquisition Executive first approved IVAS's development effort on September 25, 2018, and an Other Transaction Agreement for the development of IVAS was issued to Microsoft in November 2018. Initial testing began in March 2019.[11]
2020
Early models of IVAS were very similar to civilian HoloLens 2 headsets, which were not resistant to inclement weather and could not even function in rain.[1][12] IVAS entered its third iteration in October 2020, the first version to be ruggedized for military use. The system was tested in late October 2020 at Fort Pickett by some Marines and members of the 82nd Airborne Division. The test was to get soldier feedback and refine the system for eventual battlefield use.[1]
2021
After nearly 2 years in development, the final IVAS Capability Set 4 system was scheduled to be fielded in 2021. Over 40,000 sets were planned to be issued.[1]
On March 26, 2021, Microsoft was awarded a "fixed price production agreement" by the United States Army to manufacture and supply IVAS headsets.[13] Microsoft would produce headsets for at least 120,000 members of the Army Close Combat Force.[14] The contract was worth up to US$21.88 billion.[15]
In September 2021 an "Adversarial Electronic Warfare and Cybersecurity Test" of IVAS was conducted.[16] In mid-October, the system's "Operational Test and fielding" was moved to 2022. David Patterson, PEO Soldier Director of Public Affairs, said: "The Army intends to continue developing and fielding this revolutionary, first-of-its-kind technology in FY22."[16]
2022
Initial operational testing of IVAS began in May 2022 and concluded in late June, although at the time it was believed that the fielding of IVAS in September was unlikely.[17][18] Nevertheless, in September 2022, the US Army began accepting 5000 units of the IVAS and was planning to field them, even though these units were still early versions of the IVAS and would require future software upgrades.[19] However, in November 2022, the US Army announced a "course correction" to the program, due to soldiers reporting physical ailments after using IVAS in the field. [20] The main symptoms were headaches, eye strain, and nausea. A report by the Department of Defense Office of Inspector General raised concerns that these problems may lead to soldiers not using the system even if it was issued to them.[21] The US Army and Microsoft decided to renegotiate their contract and redesign the form factor while still planning to field 10,000 initial units.[20]
2023
In March 2023, following the "course correction" to the program with Microsoft, the US Army exhibited IVAS version 1.2. Although the new variant was still based on the civilian HoloLens headset, there had been some changes from previous versions, such as the separation of the controller from the computer, with the controller now able to be attached to any part of the upper torso and the computer being mounted on the rear of the helmet.[22] The previous helmet-like display was replaced by a flat display with better clarity, better line-of-sight, and also a hinge that allows the display to be flipped up. As a result, the field of view was reduced from 70 degrees to 60 degrees. The thermal camera was also being improved to increase clarity while reducing power consumption.[4]
Problems still existed in the new version. The newly added "Squad Immersive Virtual Trainer" encountered a issue known as "dynamic occlusion limitations", which was the inability of augmented reality devices to simulate how the user's view of virtual objects was blocked by real objects. Experts in the field had yet to find a general solution to the issue, although the US Army stated that it would work to fix it.[23]
Testing of IVAS 1.2 began in August after 20 prototypes were delivered to the US Army.[5] Microsoft was awarded another $95 million for the next stage of the program, which included the delivery of 280 pre-production and "production representative" IVAS 1.2 systems for testing in Fiscal Year 2024, aiming to field an improved version of IVAS in Fiscal Year 2025.[24]
Reception
The various issues in the system's development have often caused concern in the United States Congress. In December 2020, Congress decided to cut $230 million of the $1.1 billion request for the Army's IVAS goggles. It also wanted the US Army to submit a report detailing the acquisition strategy for the IVAS program by 15 August 2021.[25] In March 2022, considering the numerous technical issues the program encountered, Congress again withheld approximately $400 million in funding for the program until IVAS completed its initial operation testing and the Program Executive Office Soldier briefed the appropriations committees on the program's progress.[26][27]
Soldiers involved in testing IVAS also expressed their dissatisfaction with the system. One soldier commented that "the devices would have gotten us killed", referring to the glow emitted by the headset that can be seen from hundreds of meters away. They were also concerned about the limited peripheral vision and the bulkiness of the system that restricted their movement.[28] In an "unusually stinging" report, the Department of Defense Inspector General stated that the US Army wasn't effectively measuring user satisfaction with IVAS and that it was "wasting money" if soldiers don't like the system. The Army contested the report's conclusions, describing them as "fundamentally flawed and inflammatory", although the Army partially agreed with recommendations to better measure acceptance of the system.[29]
The Director, Operational Test and Evaluation report published in January 2023 criticized the performance of IVAS 1.0 in tests. It stated that most soldiers testing the IVAS headset reported a wide range of physical impairments and numerous technical deficiencies that negatively impacted their performance. It found that soldiers accomplished their missions better with their current equipment than with IVAS. Furthermore, there were no improvements or even declines in the system's reliability throughout its development.[3]
Despite the numerous issues and criticisms, the US Army remained optimistic about the program. Doug Bush, the Assistant Secretary of the Army for Acquisition, Logistics, and Technology, believed that the program is "on a good track", saying: "I think early returns are positive, which is a good thing to see."[24] A news release from the US Army stated that despite the previous delays, IVAS will still be fielded "several years ahead of standard acquisition programs".[30]
References
- 1 2 3 4 Keller, Jared (November 3, 2020). "The Army's next-generation headset is almost ready for prime time". Task & Purpose. Archived from the original on November 17, 2020. Retrieved November 18, 2020.
- ↑ "IVAS Production Contract Award". U.S. Army Program Executive Office Soldier. March 31, 2021. Archived from the original on April 1, 2021. Retrieved May 5, 2021.
- 1 2 "FY 2022 DOT&E Annual Report submitted to Congress" (PDF). Director Operational Test and Evaluation. January 2023. p. 110. Archived (PDF) from the original on May 15, 2023. Retrieved May 15, 2023.
- 1 2 Roque, Ashley (May 10, 2023). "Last stand for IVAS? New challenges, delays as Army debates future of augmented reality goggles". Breaking Defense. Archived from the original on November 4, 2023. Retrieved June 15, 2023.
- 1 2 Shear, Frederick (August 1, 2023). "Army accepts prototypes of the most advanced version of IVAS". U.S. Army. Archived from the original on October 25, 2023. Retrieved October 25, 2023.
- ↑ South, Todd (December 29, 2023). "Army's mixed reality device nears fielding with final testing in 2024". Army Times. Retrieved January 16, 2024.
- ↑ Mizokami, Kyle (March 8, 2021). "The Army's New Goggles Let Soldiers See Right Through Walls". Popular Mechanics. Archived from the original on September 10, 2021. Retrieved September 10, 2021.
- ↑ Cureton, Demond (June 30, 2021). "US Army Integrates IVAS Headsets For Aircraft Crews". XRToday.com. Archived from the original on September 10, 2021. Retrieved September 10, 2021.
- ↑ Swarts, Phillip (October 26, 2015). "F-35 helmet costs $400,000 — 4 times that of predecessor". Air Force Times. Archived from the original on January 14, 2024. Retrieved September 10, 2021.
- ↑ Roque, Ashley (June 1, 2021). "Pentagon budget 2022: US Army plans to spend USD29,205 per IVAS unit". Janes.com. Archived from the original on September 10, 2021. Retrieved September 10, 2021.
- ↑ "Director, Operational Test and Evaluation FY 2019 Annual Report" (PDF). Director, Operational Test and Evaluation. December 20, 2019. p. 85. Archived (PDF) from the original on December 1, 2023. Retrieved June 15, 2023.
- ↑ Freedberg Jr., Sydney J. (October 5, 2020). "From 'Frankengoggle' To Battle-Ready: Army IVAS". Breaking Defense. Archived from the original on October 5, 2023. Retrieved December 5, 2023.
- ↑ Patterson, David (March 31, 2021). "IVAS Production Contract Award". U.S. Army Program Executive Office Soldier. Archived from the original on March 31, 2021. Retrieved April 1, 2021.
- ↑ O'Brien, Matt (March 31, 2021). "Microsoft wins $22 billion deal making headsets for US Army". The Seattle Times. The Associated Press. Archived from the original on April 22, 2021. Retrieved April 1, 2021.
- ↑ Freedberg Jr, Sydney J. (March 31, 2021). "IVAS: Microsoft Award By Army Worth Up To $21.9B". Breaking Defense. Archived from the original on March 31, 2021. Retrieved April 1, 2021.
- 1 2 Foley, Mary Jo (October 15, 2021). "U.S. Army postpones its $22 billion Microsoft augmented-reality headset deliverables to late 2022". ZDNET. Archived from the original on October 31, 2021. Retrieved October 31, 2021.
- ↑ Roque, Ashley (May 5, 2022). "US Army greenlights IVAS initial operational test and evaluation for mid-May". Janes. Archived from the original on November 23, 2022. Retrieved November 23, 2022.
- ↑ Roque, Ashley (July 27, 2022). "US Army weighing IVAS production decision, unlikely to meet September fielding date". Janes. Archived from the original on November 23, 2022. Retrieved November 23, 2022.
- ↑ Roque, Ashley (September 9, 2022). "US Army receiving early IVAS units, will roll out software upgrades". Janes. Archived from the original on November 23, 2022. Retrieved November 23, 2022.
- 1 2 Roque, Ashley (November 9, 2022). "Course correction: US Army renegotiating USD22 billion IVAS contract, eyeing path for different form factor". Janes. Archived from the original on November 23, 2022. Retrieved November 23, 2022.
- ↑ Atherton, Kelsey D. (October 22, 2022). "Why the Army hates AR goggles". Popular Science. Archived from the original on May 15, 2023. Retrieved May 15, 2023.
- ↑ South, Todd (April 5, 2023). "Changes ahead in the next version of the Army's 'mixed reality' goggle". Army Times. Archived from the original on April 9, 2023. Retrieved April 28, 2023.
- ↑ Roque, Ashley (August 3, 2023). "Army's pricey IVAS goggles meet a training obstacle: Doors". Breaking Defense. Archived from the original on November 10, 2023. Retrieved October 25, 2023.
- 1 2 Harper, Jon (September 21, 2023). "Army awards Microsoft $95M for additional IVAS 1.2 headsets, virtual trainers". DefenseScoop. Archived from the original on October 25, 2023. Retrieved October 25, 2023.
- ↑ South, Todd (December 9, 2020). "Congress cuts some funding for Army's cutting edge, do-it-all goggle". Army Times. Archived from the original on April 4, 2021. Retrieved March 11, 2021.
- ↑ Roque, Ashley (March 11, 2022). "Lawmakers call for IVAS procurement cuts, US Army weighing implications". Janes. Archived from the original on November 23, 2022. Retrieved November 23, 2022.
- ↑ Eversden, Andrew (March 11, 2022). "Congress puts $349M for IVAS 'on hold,' but Army sees major boost to counter drones". Breaking Defense. Archived from the original on November 23, 2022. Retrieved November 23, 2022.
- ↑ Smith, Adam (October 13, 2022). "Microsoft's smart goggles 'would have got us killed', army reportedly says". The Independent. Archived from the original on December 5, 2023. Retrieved December 5, 2023.
- ↑ Ferran, Lee (April 22, 2022). "Army could be 'wasting' $22B if soldiers don't like IVAS: Inspector General". Breaking Defense. Archived from the original on April 22, 2022. Retrieved December 5, 2023.
- ↑ Shear, Frederick (March 14, 2023). "IVAS' Campaign of Learning Ensures Development, Production and Fielding Remain on Track". U.S. Army. Archived from the original on December 7, 2023. Retrieved December 6, 2023.