United States

There is immense pressure to improve the effectiveness and quality of maintainer training with a direct correlation between maintenance efficiency and operational readiness. The spread and acceptance of virtual and augmented reality technologies have made these capabilities a must-have for training personnel.

These technologies immerse and engage students, reinforce proper techniques, save on equipment wear and tear, enabling students to train at their own pace, and improve the safety and efficiency of training in a safe environment.

VE mentor allows developers to easily transition training content from the classroom to the hands-on experience in augmented reality on HoloLens 2 and mobile devices. At the same time, VE Mentor allows content authored on the “flight-line” to flow back into the classroom, closing the loop on providing efficient and effective maintenance training.

This presentation will discuss utilizing Mixed-Reality technology to keep classroom training current, efficient, and comprehensive.


TEAR 3M 2021

VE Mentor: A Mixed-Reality Training System with a Secure Cloud Solution

mixed-reality training

augmented reality training

virtual reality training

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

Anyone who has spent time recently working in the immersive training and simulation space fully understands the voracious appetite for new training content. Instructors and curriculum designers are often unable to keep up with the ongoing content demands of their XR training programs. The ultimate solution to address the current content drought is to deliver tools to end users that democratize and streamline the process of creating and maintaining content to enable training professionals to be more independent and efficient in managing their training program.

During this session, we will present our perspective on the key characteristics that we believe must be addressed in order to provide a meaningful capability for instructors and curriculum designers to be self-sufficient in the creation and maintenance of training content as part of their immersive learning programs.

A Primer: No-Code Content Authoring Tools to develop Fully-Immersive, 6DoF Experiences

In this talk, we will highlight our work in collaborative augmented reality (AR) CAD visualization and procedure assistance with ProtoSpace. Being used at JPL for several years both on the web and with HoloLens, ProtoSpace has proven to be useful in various scenarios ranging from early design, procedure planning and execution, as well as post-launch troubleshooting. This talk will showcase our work with AR procedure execution with the Cold Atom Lab, the undersea habitat NEEMO, as well as most recently the VITAL ventilator project.

Collaborative AR CAD Visualization and Procedure Assistance with ProtoSpace

Imagine all the problems augmented reality (AR) could solve if a simple tool existed that allowed anybody to publish AR experiences within minutes. BUNDLAR is a web based platform that provides a no-code, drag and drop interface for authoring, editing, and publishing AR. Novice users can learn to publish AR in as little as 30 minutes. While simple to use, the BUNDLAR platform provides a powerful set of features that make it easy to publish and access on-demand training, performance support, and instructional materials. This talk will demonstrate - in real time - how to structure, develop, and publish a set of AR based instructions using the BUNDLAR platform.

No-Code Authoring, Editing and Publishing of Augmented Reality to Mobile Devices using BUNDLAR

This talk presents a framework for quantitatively evaluating Augmented Reality and other training solutions for a given training environment based on four factors: Task Factors, Training Media Factors, Return on Investment (ROI) Factors, and Training Efficacy Factors. The framework, based upon the “House of Quality” matrix, helps compare, visualize, and assess user and technical requirements as well as identify research gaps.

Framework for Evaluating Training Efficacy for Augmented Reality

Digital humans, created from mixed reality, volumetric video capture, are fast becoming the next great teaching tool that any global-scale operation can benefit from. Imagine capturing your best technicians, engineers, soldiers and first responders in three-dimensional video to train future generations on new tools, software, maintenance, procedures and more, on-demand and anywhere in the world.

Avatar Dimension aims to drive innovative volumetric captures to the forefront with its new, state-of-the-art studio in Washington D.C. In this talk, Zenk will discuss how the company is focused on bringing this technology to all sectors of government, military, healthcare, private industry and more, including how it works, potential applications, ability to scale and ROI impact. He’ll also discuss how the U.S. government and military are uniquely positioned to benefit from volumetric capture-based training due to its previous investments in Hololens2 and Azure.


Technical Training for Industry and Military Leaps Forward with XR Volumetric Capture

Augmented Reality helps us tell a better story. It erases the line between imagination and the real world and opens the doors for new possibilities. With immersive devices becoming more accessible, the focus is not how we interact with these objects, but rather what it takes to create these objects. Investing too much time in modeling something that already exists in the real world can be a nightmare. With 3D scanning, this process is quick and precise. Discover the benefits of Creaform's metrology grade solutions and how they can be used to speed up asset creation for your AR applications.

Expediting Asset Creation for AR Applications With 3D Scanning

3D technologies have always chased the ultimate dream of an experience that is indistinguishable from reality. We've made huge strides with a variety of stereoscopic technologies ranging from glasses and HMD-based designs to autostereoscopic displays, and we've even seen the emergence of early light field technologies. But each of these has shortcomings, and the ultimate solution is much closer than most people realize.

This talk focuses on the state of play in holographic technology, the expected evolution of the technology in the next 3-5 years, and how this applies to the defense community, the broader commercial community, and ultimately the consumer space.

Holographic Displays: The Final Frontier of XR

In order to create and explore simulations of the world that are valuable for training and operations, Augmented Reality and Virtual Reality technologies need geospatial precision and global scale. The rise of sensors and unmanned platforms has produced an explosion of 3D geospatial data that can make simulations unbelievably realistic and current - but how do we get all that data into the picture and produce an environment with the performance users expect? With an open, web-enabled approach to 3D graphics, data optimized for streaming with Open Geospatial Consortium (OGC) standards, and an API made for open integration, anyone can take the most detailed models of our world and see them all at any scale. With this approach, Cesium allows developers and users to make all kinds of 3D geospatial data quickly and easily useful for mission critical visualization and analysis.

Enabling 3D Geospatial for AR/VR

3D scanning has revolutionized manufacturing and maintenance activities with the fastest cycle time and highest resolution data available on the market today. ARIS Technology streamlined these activities by providing an end-to-end robotic 3D scanning solution to automate the currently manual inspection process. To further enhance the ease of use of the system, ARIS has partnered with government and commercial partners to research and develop Mixed Reality (MR) goggles-based user-interface (UI) for intuitive operator programming of robot motions for 3D scanning. MR robotic programming greatly reduces the cost of operator training, fixturing, and digital twinning. This programming also allows ARIS to build agile and reconfigurable robotic systems that can 3D scan and inspect small component parts to large ships. We will present our learnings from MR R&D, use cases, industry trends, and our thoughts on how MR will continue to revolutionize robotic programming in the 3D scanning process.

Mixed Reality (MR) with Robotic Automation for Quality Inspection & Maintenance

The RC-135 Rivet Joint Virtual Trainer allows Airmen to accomplish familiarization and crew position checklist training sans the aircraft. This VR Digital Twin acts as a Virtual Trainer for the 55th Wing and allows airmen to conduct free-roaming training by interacting with over 3,000 virtual interactive objects. Users interact with the environment through physical interactions that mimic the real world motions airmen use on the actual RJ. The application of the RJ Virtual Trainer holds the distinction as being the first VR sim to be cleared for training in lieu of real-world “On Aircraft” training in the US Air Force. The Sim design supports more training than what is currently offered via “Hard-coded training.” The sim also features a “Facilitator Light” mode which allows a facilitator to monitor and adjust training on the fly. The Sim will have multiplayer functionality in Q2 2021 allowing for more realistic group training scenarios/exercises and training throughput.

Premium content

Downloads

Next from TEAR 3M 2021

A Primer: No-Code Content Authoring Tools to develop Fully-Immersive, 6DoF Experiences

Similar lecture

Mixed Reality Applications in Training and Operational Efforts