United States

Headwall is a patent pending technology that utilizes standard AV infrastructure to virtualize the command center video wall. The presentation will explore

TEAR 3M 2021

Headwall: Augmented Reality Video Wall for Command Centers and Watchfloors

video wall

hevc

h.264

h.265

streaming video

jsoc

watch floor

command center

data visualization

security

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

* To spread awareness of current machine learning research relevant to Naval applications

* To connect machine learning researchers with experts in military requirements

* To build and strengthen collaborations within the defense research community

**Watch this video to hear about the AFCEA purpose.**

<iframe width=1280 height=706 frameborder="0" scrolling="no" src="https://screencast-o-matic.com/player/creleVVcvRh?v=6&ff=1&title=0&controls=1" allowfullscreen="true"></iframe>

NAML 2021

technical paper

Brought to you by **National Defense Industrial Association ([NDIA](https://www.google.com/url?q=https%3A%2F%2Fwww.ndia-sd.org%2F&sa=D&sntz=1&usg=AFQjCNHj_BQx1K4KVKKp1NTIsAltZOG9Vg))** and hosted by the **Battlespace Exploitation of Mixed Reality ([BEMR](https://cdn.dvidshub.net/media/video/2101/DOD_108139354/DOD_108139354-1024x576-1769k.mp4)) Lab**, at **Naval Information Warfare Center Pacific ([NIWC PAC](https://www.google.com/url?q=https%3A%2F%2Fwww.public.navy.mil%2Fnavwar%2FNIWC-Pacific%2FPages%2Fdefault.aspx&sa=D&sntz=1&usg=AFQjCNFNS160IEsocfaBrnCNB3u7NqLHPw))**, and welcoming academia, government/DOD, and industry leaders who support Industrial Augmented Reality/Virtual Reality by using the following technologies:   


* Augmented Reality (AR) / Virtual Reality (VR)

* 2D/3D displays

* mobile displays

* wearables

* any other "immersive" technology

### In all fields that touch:

* 3D modeling

* Manufacturing 

* Installations 

* Maintenance and Repairs

* Construction

* Logistics

* Additive manufacturing

* Training

The technical exchange is a two day event held online this year due to COVID-19. It will feature two days of oral presentations, demonstrations, and posters from leaders in AR/VR and other display technologies, including government briefings on active projects within the DOD. The technical exchange is unclassified and we welcome participation from the Navy, DoD as well as from industry and academia. 

The goals of TEAR 3M are:

*  To spread awareness of current immersive technology research relevant to Navy/DOD applications

*  To connect AR researchers with experts in DOD to learn about needs and requirements

*  To build and strengthen collaborations within the DOD research community

![](https://assets.underline.io/uploads/markdown_image/1/image/0c13ac0ffa096b2353573964d8b89789.png)

TEAR 3M General Chairs:

Heidi Buck,  Director @ BEMR Lab, Naval Information Warfare Center, Pacific

Lauren Burnette, BEMR Lab, Naval Information Warfare Center, Pacific


For more information, contact Lauren and Heidi at:  tear3m@spawar.navy.mil

Questions regarding sponsorship/registration contact:  ndiasd@sandiegositepros.com

Conference host POC is Tammy Sanchez (NDIA):  tamsanch@cisco.com

Due to the adoption of additive manufacturing, virtual reality, and 3D scanning technologies within the DoD, the sharing of sensitive and controlled 3D data has become more common and prevalent than ever. Especially for DoD assets, the integrity of the 3D data being shared is paramount. Discussed here are steganography solutions for 3D data that address some of the new data sharing problems that the DoD is facing. The methods discussed focus on meshes (for 3D printing applications) and point clouds (for large scale scanning documentation), but could be adapted to new formats.

RESTORE Lab: Implementation and Applications of Steganography to 3D Data Distribution

The DoD is playing catch up with industry but we are seeing significant positive results from the Open Topic initiative.

AFVentures overview of Open Topic SBIR/STTR

In order to be effective in the field, the military trains warfighters. The goals of training are for the warfighter to learn (1) vehicle and weapon operations and dynamics (e.g., how the vehicle and gun turret work and “feel”) in live tactical situations and (2) how to effectively coordinate with team members and joint operations.

The military employs both live and virtual reality training to achieve these goals. Live training, especially gunnery, requires significant facilities and range infrastructure and is also limited to specific sites due to safely restrictions. Unfortunately, live training is expensive. In this work, augmented reality based training systems are presented. The trainees are able to walk and drive on physical terrain and engage virtual entities for tactical and gunnery training. By augmenting the real world using virtual entities and effects, along with existing training aids and devices, training anywhere and anytime is enabled.

We present three systems in this talk to address the training challenges. First, AR-unaided eye is a head mounted Augmented Reality (AR) system that allows dismounts to train. Second, AR-binoculars is a set of fixed-zoom optical sights that enable stable AR insertions at long ranges. Third, AR-Stryker is a vehicle-borne AR training system for augmenting the views of the driver, commander, and gunner. All of the systems rely on inertial measurements, cameras, and GPS to provide jitter free, real-time pose estimation. Synthetic targets (e.g., dismounts, technical, target) are rendered. We will share system hardware details and video samples of the AR renderings.

Augmented Reality Training for Forward Observers and Vehicles

Welcome to SOFWERX! A non-profit, partnered with the United States Special Operations Command (USSOCOM), in a mission to solve challenging problems for the Warfighter. Through collaboration, thought leadership, and rapid prototyping, our team ultimately helps deliver innovative technologies to the SOF soldier. With the assistance of USSOCOM, Innovators, Academia, and National labs we ensure best-of-breed capabilities are making it into the hands of Nation’s heroes.

How to Engage with SOFWERX and USSOCOM

Lockheed Martin’s (LM) Missile and Fire Control (MFC) is exploring model-based advanced visualization environments designed to holistically cover Engineering, Manufacturing, and Sustainment life cycle use-cases. Future affordability is key as the advanced visualization teams work towards maintaining customer flexibility and security requirements, analyzing interoperability between software toolsets and hardware platforms, pushing for open data standards, and necessitating open-architecture frameworks to minimize vendor or point-solution obsolescence impacts.

Lockheed Martin MFC – A Holistic Approach for Advanced Visualization Implementations

Use of augmented reality paired with a backend of electrical signaling emulation for use with diagnostics procedures to enhanced the ability for real-time fault detection, reduction of ambiguity groups and reducing reliance on pre-authored specific diagnostic procedures. Use of defined algorithms to compare expected signal state emulation of a system to real-time sensor data state through use of augmented reality headset sensors and embedded diagnostics to validate the dynamic changes and determine fault conditions and increase chances that the first repair actions will fix the system.

Augmented Reality With Electrical Emulation for Diagnostics

Today we are already seeing vision based Artificial Intelligence (AI) systems being developed throughout defense. In autonomous vehicles we see that there are systems that can take video and other sensor information and detect objects, signs and lane markings. In robotics systems have to use perception to understand their environment so they can safely interact with humans and recognize components and products that they are going to manipulate. In aircraft maintenance training systems there is the need to replace manual aircraft inspections to identify components that need repair. Finally, we also see vision based AI systems in force protection where we can identify anomalous behavior and potential threats on the stream of massive data that we have collected. This presentation will start by going over the different challenges associated with computer vision applications for Augmented Reality (AR) today. It will then introduce you to Unity Perception. Highlighting what is it, what it does, and why AR based computer vision applications can benefit from it. Then it will provide a short overview of an AR iPad application customer use case Unity worked on. Lastly, it will wrap up with where Unity can take Unity Perception in the future. 



Unity Computer Vision

To address the Navy's need for cross-domain transition goggles with an integrated, illuminated display, Intellisense Systems, Inc. is developing a new Transition Wide-Angle Goggles with Integrated Illuminated Display (TWIGIID) based on an innovative design that uniquely integrates an ellipsoidal visor with reflective coating, free-form plastic-molded optics, and high resolution miniature microdisplays. The use of ellipsoidal reflectors provide wide Field-of-View; (FOV) distortion-free collimation; and free-form surface design to correct the geometrical distortion over swim goggles. Water-proof sealing of the microdisplay and electronics allows seamless transition between underwater and above-water operation. Use of a passive coating and purging with dry gas enables the small goggles to be cleared if flooded with water, to equalize pressure as needed, and to be fog-free. The proposed TWIGIID device will have revolutionary new capabilities in Augmented Reality (AR) visualization, with an extremely light and low-profile goggles integrated display, that will be producible at low cost. By providing these new capabilities, the TWIGIID device can help provide the Navy, Air Force, Marine Corps, and other military forces with enhanced situational awareness and capabilities.

Transition Wide-Angle Goggles with Integrated Illuminated Display

The digital revolution can no longer be ignored, the warfighter requires real-time access to fully interactive digital twins in support of their specific mission. Using automation digital twins can be created rapidly and affordably for every DoD weapon system in support of design, training, and logistics.

Digital Twins for the Warfighter

Mixed Reality is evolving rapidly with ever increasing examples of successful operational deployment and growing confidence in the maturity of Mixed Reality solutions to support a range of analytics, training, and operational functions and deliver the operational effect and efficiencies that were predicted. Sensor data and AI integration in mixed reality will provide new way to interact with and explore sensed environmental and geo-spatial data, as well as high-resolution imagery enabling increased autonomy for remotely deployed operators, while retaining the capacity to reach back and collaborate with experts to support analysis, decision making and mission planning and rehearsal.

Premium content

Headwall: Augmented Reality Video Wall for Command Centers and Watchfloors

Downloads

Next from TEAR 3M 2021

RESTORE Lab: Implementation and Applications of Steganography to 3D Data Distribution

Similar lecture

AI in Global Context: The Imperative for Leding AI Transformation