United States

The Extended Digital Thread (EDT) project in the MBE Program has recently explored research and standards opportunities in augmented reality (AR) for smart manufacturing systems (SMS). This presentation introduces our latest thinking behind trends in standards development for spatial representations in product systems with an emphasis on mixed reality (XR) application development. The presentation features (1) a solution for coordinating inspection data to design data through knowledge graphs, (2) concepts for porting this mapping within an AR environment, and (3) preliminary plans for conducting baseline measurements for asset tracking technologies. Fundamental to each of these concepts is standards. Standards are critical for harmonizing the latest XR development with SMS technologies at scale.

TEAR 3M 2021

Facilitating Interoperability for Industrial XR through Standards Harmonization

standards; smart manufacturing; industrial augmented reality; digital thread

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

An introduction to NavalX, its mission, and role in the DOD innovation ecosystem.

NavalX

NSWC PHD leads much of the sustainment efforts for Navy surface combat systems. In this role, we are responsible for many maintenance inputs including maintenance procedures, troubleshooting procedures and aids, tools, and testing. Augmented reality is a strategic technology for this community and for NSWC PHD. In recent years we have done several AR maintenance demonstrations, and now given the current state of the technology, our priority is shifting away from demonstrations and into content development and tech transition. Talk will cover collaborations with other WFCs (NSWC PD), collaboration with NIWC PAC (BEMR and RESTORE), and lessons learned from integrating virtual reality content into the training program of directed energy systems.

NSWC PHD AR and VR Use and Roadmap

Virtual Reality (VR) and Augmented Reality (AR) technology has a wide variety of possible uses and applications, which continue to grow regularly. Previously, this technology used crude computer-generated graphics, but with new technology, it now can be photorealistic. Photogrammetry is a technology which uses images to create 3D scans of objects and places, which are perfect for use in the training of law enforcement, public safety, and soldiers. The benefit is that the future experts can train and improve their skills remotely, and practice potentially hazardous tasks in a safe virtual environment.

RealityCapture is the go-to tool when it comes to the creation of content and assets for VR and AR. It offers best-in-class speeds for using images to create 3D scans of scenes and environments, and is not limited by the size of area, or amount of data.

RealityCapture: Photogrammetry an essential tool for VR and AR creation

Mixed reality is being adopted by enterprises and government as an alternative to costly or high-risk real world work situations. In this talk we will hear from Matt Fedorovich, National Lead for Immersive Technology at Insight, on how organizations are leveraging the HoloLens 2 and Remote Assist to deliver knowledge, support, and expertise remotely. Matt will also discuss how Insight supports organizations to accelerate deployment and implementation of the HoloLens 2, Dynamics Remote Assist and Guides, and other mixed reality use cases in their environment.

Enabling Remote Experts with the Microsoft HoloLens 2 and Remote Assist

UAVs are a great tool for rapidly, accurately, and safely inspecting the condition of infrastructure. NIWC Pacific has been at the forefront of pushing these capabilities for the Navy. This talk will center on the work we have done, plan to do, and how we see things evolving alongside computer vision and augmented reality technologies. As operating UAVs within the DoD comes with its own unique set of challenges, this talk will also address the DoD UAV waiver process in hopes of preventing more organizations from running afoul of this policy.

NIWC Pacific, RESTORE Lab: “UAV inspections for sustainment, in the Navy”

working with Defense Innovation Unit to accelerate DOD adoption of commercial technology, transform military capabilities, and expand the National Security Innovation Base

Working with DIU

We present AR-Mentor, an AI enhanced application based on AR and Virtual Personal Assistance (VPA) technologies. AR-Mentor combines AR, Human Behavior Understanding, VPA technology and Scene Understanding to provide guidance. The system is designed to act as a personal mentor, providing human-like understanding and guidance. It provides a heads-up and hands-free experience. The user can train anywhere and use the system for providing guidance during actual maintenance or operation of the equipment. VPA is a dialog system that can listen and respond to users while maintaining conversational and environment context throughout the dialog. Scene understanding module enhances the typical AR systems with recognition of objects/parts in the scene. The behavior understanding module interprets user movements, actions, gestures and speech in the context of the task at hand. We will present results from experiments we did at the Bradley Vehicle Maintenance Training Center.

AR-Mentor: Augmented Reality Maintenance Training System

As the DoD continues to test the efficacy of XR products for training, there are challenges that remain for secure, efficient, and effective implementation. These challenges include providing 1) one place for discovery and distribution of XR products, 2) a streamlined way to use different XR products in one training course based on which is optimal for the KSAs being taught, and 3) a secure way to capture, analyze, view, and store the data from disparate products. Dynepic's DX Platform, white-labeled as MOTAR for the USAF, provides a secure infrastructure, open APIs and SDKs optimized for XR products, a marketplace for discovery and distribution of XR products, and a learning records store (LRS) and learning management system (LMS) that pull student performance data from third-party XR products into real-time, consolidated instructor dashboards. The MOTAR ecosystem will be discussed, along with lessons learned from a course run by AETC’s Maintenance Training Next Program.

MOTAR: An Ecosystem to Power the Future of Immersive Training

How do you define requirements for hardware that doesn't exist yet? Augmented reality (AR) headsets enable warfighters to take in complex spatial information without compromising situational awareness. Unfortunately, AR development is challenging because the underlying technology (e.g., displays, sensors) is constantly maturing. A proposed feature may require months of hardware development, only to discover it is too cognitively demanding to be viable. Simulating AR inside VR enables rapid prototyping of AR capabilities with full control over hardware features that would otherwise be subject to real-life limitations, such as field of view and tracking stability. In this talk I present a VR experiment simulating AR capabilities to identify usability issues and hardware requirements. I also describe the XR Testbed, a modular research platform designed to improve prototyping, simplify data collection, and improve collected data quality.

Simulating Augmented Reality Inside Virtual Reality

Extended Reality (XR) technologies present enormous potential for training, in shipyard operations, assembly and construction activities, as well as inspection and instructions for maintenance, repair, and overhaul operations. However, projects and demonstrations to date have failed to address issues of scalability. Mira will deliver a COTS solution for the creation of Augmented Reality (AR) work instructions and procedures installed on a DoD server and the consumption of this content on COTS Head Mounted Display (HMD). This brief will provide an overview of Mira tools as well some real life examples AR deployments from the Enterprise and DoD.

Premium content

Facilitating Interoperability for Industrial XR through Standards Harmonization

Downloads

Next from TEAR 3M 2021

NavalX

Similar lecture

Mixed Reality's Role in the Navy's Digital Transformation