United States

With the recent increase of autonomous and unmanned systems, decision making is increasingly getting pushed to the edge to improve the accuracy and reduce the latency of the observe, orient, decide and act (OODA) loop. Effective and safe autonomy can only be achieved when edge sensors have high quality representations of the environment, and deep learning is an important ML approach for distilling sensor information into useful insights. Getting the best possible performance on these devices is essential, especially in Denied, Degraded, Intermittent, and Limited (DDIL) environments where a central node cannot be reached to process complex information. However, deploying to legacy, compute limited or size, weight and power (SWaP) constrained devices in edge environments makes it a challenge to leverage cutting edge developments in deep learning. Frequently these solutions rely on scaling both in terms of data and number of parameters to make performance improvements. Numerous compression techniques exist to reduce the runtime, power usage, and memory requirements of neural networks, but there are not standard methods and tools to easily compare these metrics on common edge devices. To understand the impact of these techniques on a diverse set of SWaP and performance metrics, we developed a suite of bare-metal, device agnostic measurement tools for quantized and pruned machine learning models. Using this toolkit, we tested the impact of compression techniques against baseline models in a variety of settings: on AWS cloud VM instances, local workstations, and the Nvidia Jetson Orin. Results from these experiments showed the impact of model compression techniques depended heavily on hardware used both for the compression process and deployment, even when applying techniques to pretrained models. A few techniques were broadly effective, including the use of mixed precision and model pruning when supported by hardware, showing significant decreases in latency and memory with minimal impact on accuracy. However, most importantly, we found an overall understanding of model architecture and application goals is key to effective compression without the loss of overall task performance, even when tools are available for effective comparison between models, techniques, and hardware impact.

NAML 2025

Lean and Mean: Evaluating Compression Techniques for SWaP-Conscious Deep Learning

**Welcome to EMNLP 2023!**

On behalf of the EMNLP 2023 Organizing Committee, I extend a warm and heartfelt welcome to all of you to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). It is with immense pleasure and excitement that we gather here in Singapore, a vibrant hub of innovation and technological advancement.

The conference program is packed with insightful presentations, thought-provoking workshops, and engaging networking opportunities. In addition to the technical sessions, we have also planned several social events that will provide you with the opportunity to connect with your colleagues.

The conference is held in person at the Resorts World Convention Centre in Singapore, and available on-line with the help of Underline.

For those in Singapore, I hope that you will find time to explore the exciting Sentosa Island, Gardens by the Bay, Singapore Botanic Gardens and the many other attractions unique to Singapore.

Of course, we are grateful to our sponsors and partners for their generous support of EMNLP 2023, whose contributions make it possible for us to host this world-class event.

Yuji Matsumoto (RIKEN AIP) 
EMNLP 2023 General Chair

To access the **EMNLP 2023** event page on Underline, you need to register for the Conference. 
Please follow **[this link](https://2023.emnlp.org/registration/)** for more details.

EMNLP 2023

EMNLP 2023 took place in Singapore from Dec 6th to Dec 10th, 2023.

technical paper

### Welcome to the 9th annual workshop on Naval Applications of Machine Learning!

NAML is the premier annual event showcasing current machine learning research relevant to Naval applications. We welcome participation from the defense community, industry, and academia. The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team. 
 Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The goals of NAML are:

* To spread awareness of current machine learning research relevant to Naval applications
* To connect machine learning researchers with experts in military requirements
* To build and strengthen collaborations within the defense research community

#### *"What we do as a Navy is a human business. Don’t pass up an opportunity to come together as a team. Don’t pass up leadership opportunities, and don’t outsource them to a PowerPoint. If you have an opportunity to come together as a team, to increase belonging, do it."*
Admiral John M. Richardson, 31st Chief of Naval Operations

Please log in to explore this event. You need to log in with the email address you registered with. Access credentials have been sent to your email. 

Please be sure to check your spam and other email folders if you do not see an email confirmation right away.

Please log in to explore this event.

Registration for this workshop has now closed. We appreciate your interest and hope to welcome you at a future event. If you’d like to hear about similar upcoming events, please check our website or join our mailing list.

Registration for this workshop has now closed.

The 9th annual workshop on Naval Applications of Machine Learning is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team. The goals of NAML are to spread awareness of current machine learning research relevant to Naval applications, to connect machine learning researchers with experts in military requirements and to build and strengthen collaborations within the defense research community.

The Navy faces increasing challenges in detecting suspicious maritime behavior due to complexities in integrating diverse data sources and distinguishing genuine threats from routine activities. NextGen Federal Systems proposes a robust solution that uniquely integrates advanced weather forecasting and simulation capabilities into Knowledge Graph technology—a key differentiator enhancing maritime behavior analysis. Leveraging our experience developing high-resolution weather modeling solutions for programs like the Joint Simulation Environment (JSE) Weather Services and the Army Weather Operational Effects (WxOE) initiative, we address weather-related anomalies that often produce false positives.

By integrating data from sources such as AIS, SAR, EO imagery, RF signals, ship specifications, port logs, insurance databases, and sanctions lists, our approach provides a comprehensive understanding of ship behaviors. This multimodal data fusion enables analysts to identify patterns and anomalies with greater accuracy. Examples include disruptions in vessel observability due to adverse weather conditions or ship course deviations to avoid hazardous environments. By leveraging authoritative data like NOAA’s GOES satellite imagery and synthetic weather services, we ensure analysts can differentiate genuine threats from routine or weather-driven behaviors.

To enhance usability, we propose integrating Generative AI with Retrieval-Augmented Generation (RAG) to streamline querying and analysis. RAG enables analysts to pull relevant insights directly from the Knowledge Graph, providing contextual and actionable information in real time. Building on our expertise from the Synthetic Natural Battle Environment Engine (SyNBEE) SBIR project, this capability allows analysts to interact with the Knowledge Graph using natural language prompts. Our experience with simulation tools like Ansys STK enables us to model complex behaviors, such as analyzing RF signal-to-noise ratios (SNR) through atmospheric conditions to detect likely spoofing. Combined with our multimodal data integration, these tools help analysts accurately identify and model suspicious behaviors.

Further reinforcing our solution, our development of BIFROST—a modern, high-performance, one-stop web portal for the Air Force Weather Enterprise (AFWE)—showcases our ability to deliver user-centered design. By employing a Human-Centered Design (HCD) process and leveraging DevSecOps pipelines for rapid deployment, we ensure our solutions meet operational requirements at the speed of need.

Our solution aligns with the Navy's goals of applying machine learning for tactical platform data and advancing AI human factors. By fusing multimodal data, environmental modeling, simulation expertise, and user-centric design, we offer a scalable, impactful tool for maritime domain awareness, ensuring operational efficiency and decision superiority.


NextGen's Multimodal Fusion: GenAI with Environmental and Contextual Modeling for Maritime Domain Awareness

In support of the navy’s logistics, this machine learning research project evaluated automation opportunities to increase operational efficiency and resiliency of the navy’s readiness in a contested logistics environment. The overall focus is two-fold: an upstream and a downstream approach. The “upstream” approach investigates increased automation, improvements in quality, de-duplication in the configuration records (i.e., anomaly removal) resulting in better configuration and provisioning records, as well as potentially reducing the stock that needs to be managed. The “downstream” approach encompasses current developments in sustainment (i.e., predict supply and maintenance needs, indicate anomalies, and support deep dives into system health). Together, these approaches result in an efficient and accurate configuration and provisioning profile in support of a spectrum of operational aspects of ships, ultimately reducing delay times and increasing uptime in alignment with one of the Navy (CNO and NAVSEA) key tenets of 80% surge cable fleet and on-time delivery.

Applications of Machine Learning to Smart Provisioning and Predictive Sparing

Many machine learning applications are constrained by limited quantity, quality, and variance of the collected real-world datasets used for training and evaluation. In this work, authors leveraged generative artificial intelligence techniques to extend the amount of data available to train and evaluate convolutional neural networks (CNNs) for object detection and classification. Stable Diffusion was used as the core augmentation algorithm alongside traditional machine vision techniques. A variety of augmentation techniques were compared in terms of their impact on training and evaluating CNNs. The augmented images were used in part to train CNNs to improve the performance of detection models when evaluated on real-world images. Additional experiments were conducted which quantified the prediction performance on real-world data by measuring the performance on similar synthetic data. Within these experiments, various ratios of synthetic and real-world images were used to train networks which were then evaluated on real-world and synthetic holdout datasets.

Comparison of augmentation techniques with Stable Diffusion for aircraft identification

The rising popularity of spatial computing has generated an increased demand for high fidelity 3D-modeling solutions. However, most of these applications assume laboratory-controlled image conditions, which relaxes the problem. On the contrary, real-world situations require algorithms to operate under unconstrained and opportunistic imaging conditions. As part of the Intelligence Advanced Research Projects Activity’s (IARPA) WRIVA program, Accenture is developing advanced novel view synthesis technology to enable new capabilities for mission planning and preparation, remote asset monitoring and inspection, visualization and virtual reality with emphasis on building solutions for unconstrained and non-cooperative image settings. 
We have developed a computer vision capability to perform novel view synthesis and high-fidelity 3D site modeling from limited imagery (in space and time) and a diverse set of imaging sensors while addressing several environmental, data gap and architectural challenges. In addition, we have investigated algorithms that can detect and mitigate image (meta)data artifacts to improve site model representation including time stamp prediction, camera pose restoration, and image artifact detection and mitigation. 
The 3D site modeling involves learning an accurate representation of the scene’s geometry and structure given the available imagery using a combination of techniques including structure-from-motion, monocular depth estimation, and Gaussian Splatting. This learned model is then used to render arbitrary viewpoints to synthesize novel views from arbitrary viewpoints. Additionally, the model can produce high fidelity 3D site representations, including depth maps and point clouds as byproducts for more explicit access to the scene’s 3D geometry.
In this talk we will describe how, in collaboration with world-class academic institutions, we are researching and developing state-of-the-art capabilities in 3D reconstruction and site modeling (e.g., Gaussian Splatting and Neural Radiance Fields) to become a viable alternative for use cases involving point clouds and classical photogrammetry. We will discuss how we are building site models and reconstructing large outdoor scenes given a set of unconstrained image sensors. We will further show how we are using generative AI to edit scenes (add/remove/edit objects) in a 3D sense to facilitate interpretability and exploration.
Additionally, we will show how our computational framework can generate fly-through and walk-through renders, while a user can freely navigate in them mapped environment using their mobile device or virtual reality headset.


BELLA – Building Navigable Geospatial Environments at Large scales with Limited Imagery Under Sensor Agnostic Conditions

The pandemic related increase in the overlap of work and personal device usage as well as resulting number of malicious attacks are helping attackers generate malware variants on various operating systems. Because of these attacks, the volume, type, and sophistication of malware are continuously increasing. Consequently, an improved platform-agnostic malware analysis system is a critical requirement to stop the rapid expansion of malicious activities and minimize
using various cyber security tools for different operating systems. We propose PAMDAC, a system for platform-agnostic malware detection and classification
that satisfies such a requirement. Typically, a platform-agnostic feature derived from the analyzed malware sample does not depend on the knowledge of the platform which the malware targets. In this comprehensive study, we look at the performance of different binary features for malware detection and classification on various platform (Android, Linux and Mac OS) datasets. Experimental results are quite
promising with highly accurate classification results on various malware datasets. Finally, we perform a case study to look at the effectiveness of using such
platform-agnostic features on the amalgamation of the aforementioned datasets for malware detection.

PAMDAC: Platform-Agnostic Malware Detection And Classification Based On Binary Features

Microelectronics and Advanced Packaging Technologies (MAPT) is a critical multidisciplinary field with the potential to transform the design and manufacture of future microchips. These advances build upon breakthroughs in advanced packaging, 3D monolithic and 2.5D/3D heterogeneous integration, electronic design automation, nanoscale manufacturing, and energy-efficient computing. The workshop will present the first 3D semiconductor roadmap to guide the forthcoming microelectronic revolution, like the International Technology Roadmap for Semiconductors (ITRS) has served in the past. The main goal of this workshop is to discuss with the DoD community the topics of the MAPT Roadmap, identify the core shared issues and collect input to the MAPT Roadmap 2.0 edition.

The MAPT Roadmap - A Plan to Revitalize the Semiconductor Industry for Decades to Come

The GenAI for Wargaming initiative, part of the CAIMANS project, explores the integration of Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) to automate the creation of military wargaming scenarios. Traditional scenario development is time-intensive, requiring extensive human effort to research, analyze, and synthesize operationally relevant content. This project aims to enhance wargaming efficiency by using AI to generate “Road to War” briefs, tactical vignettes, and executable simulation scripts in seconds rather than days.

In Sprint 1, the team developed an AI-driven pipeline that leverages LLMs to generate structured, contextually accurate wargaming scenarios. By incorporating RAG techniques and verified data sources (e.g., the Janes military database), the system minimizes inaccuracies and enhances realism. A fact-verification loop further reduces AI hallucinations, ensuring generated content aligns with real-world constraints.

A key innovation in this sprint is the automated translation of scenarios into Lua scripts for execution in the Command PE simulation environment. This allows rapid scenario instantiation, enabling real-time scenario iteration and dynamic course-of-action assessments. Additionally, the project explored AI applications for DIGICAT (a digital operational wargaming system) and began assessing LLM-driven optimization models for military applications.

Results demonstrate a significant reduction in manpower and time required for scenario generation, with outputs meeting operationally relevant accuracy and fidelity standards. This system will be tested in the Northwest Pacific 2025 wargame, providing real-world validation of AI-driven wargaming automation. Future research will focus on real-time scenario adaptation, intelligent agent behaviors, and reinforcement learning integration, further advancing the role of AI in military planning and strategic decision-making.

GenAI for Wargaming - Sprint 1 - Scenario Generation using LLMs

Background: Trust in AI systems is recognized as key for team performance, for the adoption and use of new technology, and to adapt, modernize, and maintain a competitive edge. This is especially important for military and civilian operations with AI systems. However, the nature of trust is elusive, complicated, and enmeshed in a web of subjectivity. Trust is amorphous, abstract, context-dependent, dynamic, often irrational, complicated by subjective observer (trustor) dependencies, complicated by subject (trustee) dependencies, and suffers from measurement difficulties because of its tacit nature (surveys and questionnaires are estimates, not truth, because people often say or think one thing and do another). 

Objectives: The overall goal of the Operational Trust in Mission Autonomy (OPTIMA) working group is to improve models and estimates of trust to understand, diagnose, and predict usage of AI systems. This will inform AI development, human training, and human-machine teaming. The goals of this work were to create an epistemological foundation for trust estimation by: 
(1) Explicitly defining and justifying foundational beliefs,
(2) Formalizing a trust estimation methodology, and
(3) Identifying trust and trustworthiness concepts and distilling them into a socio-technical ontology of antecedents, and an ontology of contractual considerations for context.

Approach: We approached trust from a philosophical and psychological perspective by first exploring trust’s subjectivity and prevailing viewpoints. Then, we conducted a conceptual analysis of 43 scientific and 12 non-scientific publications. We then used subject matter experts to group concepts and construct ontologies.

Results: The findings of this conceptual analysis revealed that organizational processes, procedures, regulations, and governance are important for trust, yet are under-represented in the scientific literature. We labeled these enterprise sources. From this, we constructed two novel ontologies of trust relationships: a trust antecedent ontology consisting of three socio-technical sources —human, system, and enterprise — and a contract ontology covering context. We used these components to make recommendations for future research, measurements, and modeling. 


Foundations for Operational Trust in Mission Autonomy

COSMOS is a state-of-the-art government cloud infrastructure. See firsthand how its capabilities can support DoD customers, boost efficiency, propel AI/ML adoption forward, and drive mission success.

COSMOS: Moving Mission Light Years Ahead

This session will discuss the MAPT ecosystem, its foundational capabilities as well as the critical issues as seen by defense and commercial sectors. Examples include energy efficiency, functional and supply chain security, workforce development and many others.  What will manufacturing and supply chain look like in next 2/5/10/20 years?

Premium content

Downloads

Next from NAML 2025

NextGen's Multimodal Fusion: GenAI with Environmental and Contextual Modeling for Maritime Domain Awareness

Similar lecture

The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models