United States

3D scanning has revolutionized manufacturing and maintenance activities with the fastest cycle time and highest resolution data available on the market today. ARIS Technology streamlined these activities by providing an end-to-end robotic 3D scanning solution to automate the currently manual inspection process. To further enhance the ease of use of the system, ARIS has partnered with government and commercial partners to research and develop Mixed Reality (MR) goggles-based user-interface (UI) for intuitive operator programming of robot motions for 3D scanning. MR robotic programming greatly reduces the cost of operator training, fixturing, and digital twinning. This programming also allows ARIS to build agile and reconfigurable robotic systems that can 3D scan and inspect small component parts to large ships. We will present our learnings from MR R&amp;D, use cases, industry trends, and our thoughts on how MR will continue to revolutionize robotic programming in the 3D scanning process.

TEAR 3M 2021

Mixed Reality (MR) with Robotic Automation for Quality Inspection &amp; Maintenance

digital manufacturing

metrology

quality

inspection

cobot

robot

sustainment

reverse engineering

3d scanning

3d model

maintenance

digital twin

mixed reality

augmented reality

simulation

robotics

artificial intelligence

automation

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

3D scanning has revolutionized manufacturing and maintenance activities with the fastest cycle time and highest resolution data available on the market today. ARIS Technology streamlined these activities by providing an end-to-end robotic 3D scanning solution to automate the currently manual inspection process. To further enhance the ease of use of the system, ARIS has partnered with government and commercial partners to research and develop Mixed Reality (MR) goggles-based user-interface (UI) for intuitive operator programming of robot motions for 3D scanning. MR robotic programming greatly reduces the cost of operator training, fixturing, and digital twinning. This programming also allows ARIS to build agile and reconfigurable robotic systems that can 3D scan and inspect small component parts to large ships. We will present our learnings from MR R&D, use cases, industry trends, and our thoughts on how MR will continue to revolutionize robotic programming in the 3D scanning process.

Mixed Reality (MR) with Robotic Automation for Quality Inspection & Maintenance

technical paper

The RC-135 Rivet Joint Virtual Trainer allows Airmen to accomplish familiarization and crew position checklist training sans the aircraft. This VR Digital Twin acts as a Virtual Trainer for the 55th Wing and allows airmen to conduct free-roaming training by interacting with over 3,000 virtual interactive objects. Users interact with the environment through physical interactions that mimic the real world motions airmen use on the actual RJ. The application of the RJ Virtual Trainer holds the distinction as being the first VR sim to be cleared for training in lieu of real-world “On Aircraft” training in the US Air Force. The Sim design supports more training than what is currently offered via “Hard-coded training.” The sim also features a “Facilitator Light” mode which allows a facilitator to monitor and adjust training on the fly. The Sim will have multiplayer functionality in Q2 2021 allowing for more realistic group training scenarios/exercises and training throughput.

VR That Works: First USAF Approved VR ATD (Aircrew Training Device)

How do you ensure proper training during a global pandemic when access to critical equipment is limited, travel is expensive and time-consuming, and face-to-face interaction is dangerous for your health? Join us for an inside look on how Leidos creates Virtual Training for the US Air Force. See how our innovative process is solving complex training needs for today and hear their inspired vision for virtual training of tomorrow.

The Future of Military Training is Virtual. How Leidos is creating the next generation of virtual and immersive training for the Air Force.

The quality of the touch feedback in your VR training and robotics project can dramatically impact the project's success. By combining the industry's most realistic tactile feedback, strongest force feedback and most accurate motion tracking, HaptX has created an input tool so precise it can help you avoid negative training in VR. Learn about the unique microfluidic technology in HaptX Gloves and how defense customers have successfully applied it.

Realistic Touch Improves Virtual Training and Telepresence

The building process, especially in the industrial design, requires many iterations and team works, which is nowadays disrupted by health restrictions. Furthermore, market increasingly request for complex design in shorter times. 
Real-time technologies like Virtual and Augmented Reality as well as Cloud infrastructure and 5G can help accelerating the design and training process, generating a sizeable Return On Investment. This presentation explains these technologies, backed by real-life industry case studies.

Competitive CAD design and production with VR and CLOUD collaboration

Abstract: First responders (FR) need every advantage during fleeting life critical moments, and SMART cyber-physical systems (CPS) provide critical information for time-sensitive events. Wireless real-time convergence of building information modeling, interfacing of 3D data through machine to machine and machine to human analytics exchange, bio-telemetry monitoring of victims and responders will save lives. Auto-populated, legacy, and real-time remote sensed point clouds would allow FR personnel and their commanders to intelligently and visually understand their environments during the response. Mixed physics computational fluid dynamic programs allow for predictive outputs in structure and wildland fires, hazardous materials releases, and other natural and human-initiated events. Technical rescues and high life hazards will benefit SMART Cities, IoT, remote sensing, virtual, augmented, and mixed realities. The unconscious patient will be treated via facial recognition software, allowing responders to know their medical history. Complimentary real-time field communications will be transmitted to base hospital trauma surgeons-in 3D. The SMART FR- during the response, mitigation, and post-incident analysis will view emergencies through 3D projected light and holographic displays and immersive HUD lenses. The multi-sensor fusion enabled technology is focused on saving civilian lives and empowering responders.

Mixed Reality - a Suite of SMART solutions

Applications of model-based systems engineering (MBSE), particularly 3D models, are greatly improving the integration and execution of logistics engineering and management functions for complex systems. 3D models provide logistics engineers with the ability to navigate digital environments to perform analysis of maintenance and operations envelopes, equipment pathways (intermediate and depot maintenance driven), and confirmation of logistics requirement compliance prior to equipment selection and design baselining. Additionally, 3D models provide logistics managers, maintenance planners, and the training enterprise with data-rich, interactive environments where users may access complete logistics technical data from authoritative sources and determine system response to configuration changes while exploring models at multiple levels of system indenture.

Leveraging 3D Models for Logistics Engineering and Management Functions

VisionLib is a software development kit for tracking and augmenting 3D objects. Unlike HoloLens holograms which float in space, and ARkit / ARcore AR content that sticks to the ground, VisionLib AR content sticks precisely to complex objects like vehicles and machines. This enables a variety of valuable use-cases such as training, maintenance, and manufacturing.

Visometry and VisionLib Overview

Engineering approaches for evaluating head-worn displays (HWDs) are typically performed during the design and development cycle as a form of validation of HWD parameters such as field of view and resolution. But, what about the human and their needs for tasks performance? This talk outlines a user-centered approach to HWD design and development process that includes perceptual testing. We discuss the current perceptual test battery and how it is used in the iterative design process as better measure of how a targeted end-user can effectively use the display in an operational environment.

User-Centered Design for Head-Worn Display Development

Augmented Reality (AR) holds great promise in the manufacturing domain especially in the areas of machine analytics visualization, insitu toolpath visualization, assembly guidance, validation and verification of assembly steps, asset and part location tracking on the shop floor, etc. However, the true potential of AR has not been unlocked yet due to the lack of robust real time object tracking capabilities with sufficient accuracy. This is especially problematic for a manufacturing setting which is typically a cluttered environment with high volume of moving parts and people. To bridge this gap, GE Research plans to develop and test an integrated platform for multiscale and multi-fidelity tracking of objects using combination of different tracking modalities for Augmented Reality (AR) applications.

Multi-scale Multi-fidelity Tracking for AR Applications

TechBridge Ventura is based in Ventura California at the FATHOMWERX laboratory at the Port of Hueneme. FATHOMWERX was established in 2019 as a public-private consortium and resource for technical innovation and capability transition. FATHOMWERX includes 60,000 square feet of space focused on rapid innovation, disruption and audacious projects with support engagement, education, experimentation, and assessment, designed to connect operational stakeholders with technical subject matter experts who might assist in developing solutions to address operational needs. Through strategic partnerships within the region, programs conducted evaluate developing technologies against operational needs in the port and maritime domains, and suggest pathways for engagement, funding, collaboration and implementation.

Premium content

Mixed Reality (MR) with Robotic Automation for Quality Inspection & Maintenance

Downloads

Next from TEAR 3M 2021

VR That Works: First USAF Approved VR ATD (Aircrew Training Device)

Similar lecture

Collaborative AR CAD Visualization and Procedure Assistance with ProtoSpace