United States

Mixed reality is being adopted by enterprises and government as an alternative to costly or high-risk real world work situations. In this talk we will hear from Matt Fedorovich, National Lead for Immersive Technology at Insight, on how organizations are leveraging the HoloLens 2 and Remote Assist to deliver knowledge, support, and expertise remotely. Matt will also discuss how Insight supports organizations to accelerate deployment and implementation of the HoloLens 2, Dynamics Remote Assist and Guides, and other mixed reality use cases in their environment.

TEAR 3M 2021

Enabling Remote Experts with the Microsoft HoloLens 2 and Remote Assist

remote assist

hololens 2

remote tele-expert

remote collaboration

spatial

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

technical paper

UAVs are a great tool for rapidly, accurately, and safely inspecting the condition of infrastructure. NIWC Pacific has been at the forefront of pushing these capabilities for the Navy. This talk will center on the work we have done, plan to do, and how we see things evolving alongside computer vision and augmented reality technologies. As operating UAVs within the DoD comes with its own unique set of challenges, this talk will also address the DoD UAV waiver process in hopes of preventing more organizations from running afoul of this policy.

NIWC Pacific, RESTORE Lab: “UAV inspections for sustainment, in the Navy”

working with Defense Innovation Unit to accelerate DOD adoption of commercial technology, transform military capabilities, and expand the National Security Innovation Base

Working with DIU

We present AR-Mentor, an AI enhanced application based on AR and Virtual Personal Assistance (VPA) technologies. AR-Mentor combines AR, Human Behavior Understanding, VPA technology and Scene Understanding to provide guidance. The system is designed to act as a personal mentor, providing human-like understanding and guidance. It provides a heads-up and hands-free experience. The user can train anywhere and use the system for providing guidance during actual maintenance or operation of the equipment. VPA is a dialog system that can listen and respond to users while maintaining conversational and environment context throughout the dialog. Scene understanding module enhances the typical AR systems with recognition of objects/parts in the scene. The behavior understanding module interprets user movements, actions, gestures and speech in the context of the task at hand. We will present results from experiments we did at the Bradley Vehicle Maintenance Training Center.

AR-Mentor: Augmented Reality Maintenance Training System

As the DoD continues to test the efficacy of XR products for training, there are challenges that remain for secure, efficient, and effective implementation. These challenges include providing 1) one place for discovery and distribution of XR products, 2) a streamlined way to use different XR products in one training course based on which is optimal for the KSAs being taught, and 3) a secure way to capture, analyze, view, and store the data from disparate products. Dynepic's DX Platform, white-labeled as MOTAR for the USAF, provides a secure infrastructure, open APIs and SDKs optimized for XR products, a marketplace for discovery and distribution of XR products, and a learning records store (LRS) and learning management system (LMS) that pull student performance data from third-party XR products into real-time, consolidated instructor dashboards. The MOTAR ecosystem will be discussed, along with lessons learned from a course run by AETC’s Maintenance Training Next Program.

MOTAR: An Ecosystem to Power the Future of Immersive Training

How do you define requirements for hardware that doesn't exist yet? Augmented reality (AR) headsets enable warfighters to take in complex spatial information without compromising situational awareness. Unfortunately, AR development is challenging because the underlying technology (e.g., displays, sensors) is constantly maturing. A proposed feature may require months of hardware development, only to discover it is too cognitively demanding to be viable. Simulating AR inside VR enables rapid prototyping of AR capabilities with full control over hardware features that would otherwise be subject to real-life limitations, such as field of view and tracking stability. In this talk I present a VR experiment simulating AR capabilities to identify usability issues and hardware requirements. I also describe the XR Testbed, a modular research platform designed to improve prototyping, simplify data collection, and improve collected data quality.

Simulating Augmented Reality Inside Virtual Reality

Extended Reality (XR) technologies present enormous potential for training, in shipyard operations, assembly and construction activities, as well as inspection and instructions for maintenance, repair, and overhaul operations. However, projects and demonstrations to date have failed to address issues of scalability. Mira will deliver a COTS solution for the creation of Augmented Reality (AR) work instructions and procedures installed on a DoD server and the consumption of this content on COTS Head Mounted Display (HMD). This brief will provide an overview of Mira tools as well some real life examples AR deployments from the Enterprise and DoD.

Scalable AR Solutions for the Deskless Industrial Workforce

EducationXR is an extended reality (XR) platform used to create, deploy, and distribute immersive education and training content. Learn how global-leading corporations are using XR for remote learning and leveraging access to XR content from all phones, tablets, desktops, PC's, and VR headsets, including the Oculus Quest 2. Immersive education and learning is here, now, and EducationXR is a platform powering scalability and access.

EducationXR: scalable creation, deployment and distribution of XR content

Quick look into how the most advanced large scale AR platform can support your logistic and maintenance / field service process. We not only show the tech, but real up and running implementations / best practices all around the world.


the most advanced large scale AR platform for highly efficient logistics and maintenance

Maritime security and defense industries face a unique set of challenges when it comes to implementing accessible, affordable, and productive training programs. From training that needs to adapt to keep pace with operational requirements for continuous seafarer training to a delivery model that can defy communication (and cost) barriers, finding a training solution that can be adaptive, scalable, and delivered broadly enough across working locations can pose a significant challenge—one that has been amplified by today’s additional requirement of meeting a remote working condition. 
Immersive technologies can help make training accessible across spatial barriers while helping to “train the untrainable” on-site experiences, but can the creation of immersive training be made quickly and adaptable enough to keep pace with operational requirements—and operating budgets? As this presentation will explain, immersive technology on its own may not be the answer, but immersive training that is platform agnostic and which also includes an adaptive and scalable modular training creation model can help the maritime defense and security industries access training that can reduce development costs, shorten the time-to-field, and adapt to meet continuing seafarer training requirements, allowing you to turn an immersive training solution into a cost-effective, adaptive, and reusable training content strategy.


How to Unlock the Full Potential of Immersive (AR & VR) Technologies for Maritime Defense and Security Training

Straight from the BEMR Lab at NIWC PACIFIC -- some suggestions to help vendors sell items to the government. Just a short overview of common problems we have run into as we buy from vendors.

Premium content

Enabling Remote Experts with the Microsoft HoloLens 2 and Remote Assist

Downloads

Next from TEAR 3M 2021

NIWC Pacific, RESTORE Lab: “UAV inspections for sustainment, in the Navy”

Similar lecture

HyperTunnel - Teleporting Expertise Anywhere