United States

We will present a unified authoring system that enables non-technical SMEs to capture knowledge of facilities, equipment and processes to produce digital twins for personalized training on both VR and AR devices. Our approach leverages recent advances in AI (vision and language) with the goal of improving time, cost and quality of content development while substantially expanding SME participation and efficiency.

TEAR 3M 2021

Authoring tools for AR/VR Enabled Personalized Training

voice

authoring tools

assessment

vision

# Welcome everyone to ACL 2022!

The 60th Annual Meeting of the Association for Computational Linguistics is taking place May 22-27, 2022 as a hybrid event, in Dublin and online. We are happy to welcome all of you to this anniversary edition with an almost 50-50 in-person and virtual participation. 
The main conference program features oral presentations, in-person and virtual posters and demo sessions, a plenary session for our best paper presentations and awards, three amazing keynote events and two new initiatives of invited talks: Spotlight Talks for Young Rising Stars (STIRS) and The Next Big Idea Talks. Posters (including Findings of ACL 2022) and demos are grouped by areas for both the in-person and the virtual sessions. For the virtual component, the talks will be on Zoom and the posters and the demos will be in GatherTown. The Student Research Workshop will have an oral session and a poster session as part of Poster Session 1. The program also features eight Tutorials and 28 Workshops. 

 
We wish you a wonderful conference! 
[**The ACL 2022 Organizing Committee**](https://www.2022.aclweb.org/organisers)
 
[**Conference Handbook**](https://drive.google.com/file/d/1_BUCMfhMVrjG9E2e71aHdHeE28KSje0l/view?usp=sharing) 
[**Mini Handbook**](https://drive.google.com/file/d/1qlBKl0wzmlVF1oCeMQl3BahLd9nLP5Ce/view?usp=sharing) 
[**Posters and Demo guides**](https://drive.google.com/file/d/1UucMAoCNncIOaH1rMMDa0owuG9qgvJTG/view?usp=sharing)

ACL 2022

The Association for Computational Linguistics (ACL) is the premier international scientific and professional society for people working on computational problems involving human language, a field often referred to as either computational linguistics or natural language processing (NLP). 

technical paper

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

The affordances of augmented and virtual reality are being leveraged through a tool, zSpace, to deliver learning experiences for schools, business, and indiustry. By using zSpace, learners are able to do things that would otherwise be too dangerous, impossible, counterproductive, and/or expensive to do. Further, the results of integrating a collaborative AR/VR tool will be examined.

Breaking Barriers: Learning through AR/VR Experiences

Current large-scale live military training exercises leverage notecards (MILES casualty cards) to preset injuries for medics to respond to. To add realism to the medic training environment, a Modular Multimodal Casualty State and Care Toolkit was developed to present realistic medical scenarios to medics when injuries are sustained in training exercises. The system consumes injury and shot data from a training network, translates those to injuries to patients, creates a realistic physiology model of that patient to present to medics and allows them to treat injuries using augmented reality medical equipment. The system supports all stages of medic training from bag loadouts to individual and group-based after-action review. The Hololens-based AR training system will be presented to demonstrate guided learner modes (walk phase), field scenario mode, and after-action review. This work is funded under contract W81XWH19C0015 (COR Lee Sciarini, PhD, MSC USN)

Augmented Reality Medical Training for Field Exercises and Beyond

The SBIR/STTR is a robust program designed to help small businesses address government needs while promoting commercialization. This session is dedicated to providing a primer on the program with tips on getting involved and getting engaged with the Naval Information Warfare Systems Command (NAVWAR).

NAVWAR SBIR/STTR Program Overview

David Watters and Anthony Duca discuss the different technologies and methods used to rapidly scan objects, spaces, and larger geographies into a virtual space for remote, real-time collaboration, with full spatial co-presence, for planning, training, and visualization using Desktop 3D, XR headsets, and mobile solutions.

Transform How You Plan: Rapid Scanning and Collaborative XR Visualization

Once an augmented reality strategy is selected, it is critical that early deployments are successful in order to reach scale. This presentation will share best practices that Scope AR has deployed with their customers in a prescriptive way, in order to manage expectations, and successfulle reach the desired outcomes.

Flattening the HypeCycle With AR

The Virtual Equipment Environment (V2E) is a government-owned (GOTS) parts assembly and disassembly engine that allows us to easily virtualize your existing CAD models, tech manuals, or training material into a virtual immersive trainer.



NIWC Pacific, BEMR Lab:” Virtual Equipment Environment (V2E)”

HyperTunnel® is a mixed reality (MR) remote collaboration system that enables front-line workers to summon an expert in a different location into a real time, immersive and shared digital twin to collaborate, provide guidance and instructions on the task at hand. The system also serves as a training and simulation environment. 

The solution provides the following capabilities: 
• Scan Remote Worksite: Leverage input from scanners, cameras, microphones and other sensors that might be available at the remote worksite.
• Create Digital Twin at HQ: captured data is used to reproduce a real-size immersive digital representation of the worksite at a central location.
• Match / Enhance shared Scenes: AR remote worksites and VR digital twins are synched, tracked and enhanced by AI focusing on relevant objects and actions.
• Annotate and Demonstrate: Immersed users can place virtual objects and annotations, provide guidance and demonstrate actions in the shared space.

HyperTunnel - Teleporting Expertise Anywhere

The DoD and its branches face a convergence of challenges. As trusted career experts and depot artisans retire in increasing numbers, product variety and complexity accelerate. Traditional methods for scaling expertise are no longer sufficient. But there are companies who are innovating—overcoming these challenges to increase service quality and efficiency. How are they doing it?

Turning Maintenance Challenges into Opportunities with AR

Spatial is cross platform collaboration solution currently used by the DOD and IC to enable distributed intelligence briefings. This talk will elaborate on Spatial's background, how the solution works, and how it is currently being deployed by the DOC/IC, particularly in light of the mandate for Distributed Operations and the rise of telework during Covid. 



Spatial - Distributed Intelligence Briefings and the Virtual Command Post

Despite the fairly smooth progression of all the other elements of the VR ecosystem….operating systems, headsets, PCs, enterprise applications and games……creating true natural walking in VR has sat largely unaccomplished until recently. The last several years have seen several solutions for locomotion in VR including the introduction of a true omnidirectional treadmill finally providing the ability for true and natural walking. This capability provides for an immense number of use cases in the military, mainly under the umbrella of training. Training for combat is one of the most obvious though we also see training use cases for aircraft maintenance, aircraft cargo loading, pre-flight inspection training, naval ship docking training, infantry training as well as the multitude of military medical rehabilitation use cases. This talk will focus on many of the current use cases for the omnidirectional treadmill across the various branches of the military.

Premium content

Authoring tools for AR/VR Enabled Personalized Training

Downloads

Next from TEAR 3M 2021

Breaking Barriers: Learning through AR/VR Experiences

Similar lecture

FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction