Italy

Full Motion Video (FMV) and Wide Area Motion Imagery (WAMI) systems have been used extensively in the recent years to collect overhead imagery to produce value-added geospatial products. In order to better understand the limitations of these systems and to define the best flight conditions under which they can be operated, an integrated modeling and simulation (M&amp;S) framework named Sensair was developed. This paper presents how this tool can be leveraged to simulate data collections with airborne camera systems using different parameters under varied conditions. Sensair can simulate realistic large-scale environments with moving vehicles and generate representative FMV and WAMI high-resolution imagery. The built-in interactive analysis tools enable the study of the different factors impacting the application of computer vision algorithms to aerial images. This paper presents Sensair’s M\&amp;S capabilities and describes use cases where the framework is used to perform tasks that include 3D reconstruction and the generation of an image dataset to support the evaluation of vehicle detection approaches.

ICPR 2020

Modeling and Simulation Framework for Airborne Camera Systems

ICPR 2020 is the premier international conference on Pattern Recognition, gathering leading researchers from around the world to present their latest achievements in Pattern Analysis and Recognition, applied Artificial Intelligence and Machine Learning. The topic of the year is " Putting Artificial intelligence to work on Patterns". 
For the first time, ICPR has employed a two-round review process similar to journal submissions, with new papers allowed to be submitted in either the first or second round and papers submitted in the first round and not accepted allowed to be revised and re-submitted for second round review. 

In this edition of the **ICPR 2020** Conference, there are 1407 Oral/Poster presentations organized in five Tracks: 
- Artificial Intelligence, Machine Learning for Pattern Analysis; 
- Biometrics, Human Analysis and Behavior Understanding; Computer Vision, Robotics and Intelligent Systems; 
- Document and Media Analysis; and 
- Image and Signal Processing. 

The **ICPR 2020** Main Conference program also includes 7 Keynotes from prominent world-renowned scientists, 8 Tutorials, 28 Demos, 8 Challenges, 2 Panels, as well as an Industry/Sponsor Exhibition. In addition, 41 Workshops on a range of important current and emerging research topics complete the ICPR 2020 program. 


Full Motion Video (FMV) and Wide Area Motion Imagery (WAMI) systems have been used extensively in the recent years to collect overhead imagery to produce value-added geospatial products. In order to better understand the limitations of these systems and to define the best flight conditions under which they can be operated, an integrated modeling and simulation (M&S) framework named Sensair was developed. This paper presents how this tool can be leveraged to simulate data collections with airborne camera systems using different parameters under varied conditions. Sensair can simulate realistic large-scale environments with moving vehicles and generate representative FMV and WAMI high-resolution imagery. The built-in interactive analysis tools enable the study of the different factors impacting the application of computer vision algorithms to aerial images. This paper presents Sensair’s M\&S capabilities and describes use cases where the framework is used to perform tasks that include 3D reconstruction and the generation of an image dataset to support the evaluation of vehicle detection approaches.

technical paper

We propose a novel unsupervised approach based on a two-stage object-centric adversarial framework that only needs object regions for detecting frame-level local anomalies in videos. The first stage consists in learning the correspondence between the current appearance and past gradient images of objects in scenes deemed normal, allowing us to either generate the past gradient from current appearance or the reverse. The second stage extracts the partial reconstruction errors between real and generated images (appearance and past gradient) with normal object behaviour, and trains a discriminator in an adversarial fashion. In inference mode, we employ the trained image generators with the adversarially learned binary classifier for outputting region-level anomaly detection scores. We tested our method on four public benchmarks, UMN, UCSD, Avenue and ShanghaiTech and our proposed object-centric adversarial approach yields competitive or even superior results compared to state-of-the-art methods.

Local Anomaly Detection in Videos using Object-Centric Adversarial Learning

Recent years, typhoon damages has become social problem owing to climate change. In 9 September 2019, Typhoon Faxai passed on the Chiba in Japan, whose damages included with electric provision stop because of strong wind recorded on the maximum 45 meter per second. A large amount of tree fell down, and the neighbor electric poles also fell down at the same time. These disaster features have caused that it took 18 days for recovery longer than past ones. Immediate responses are important for faster recovery. As long as we can, aerial survey for global screening of devastated region would be required for decision support to respond where to recover ahead. This pa-per proposes a practical method to visualize the damaged areas focused on the typhoon disaster features using aerial photography. This method can classify eight classes which contains land covers without damages and areas with disaster. Using target feature class probabilities, we can visualize disas-ter feature map to scale a color range. Furthermore, we can realize explain-able map on each unit grid images to compute the convolutional activation map using Grad-CAM. We demonstrate case studies applied to aerial photo-graphs recorded at the Chiba region after typhoon.

Natural Disaster Classification using Aerial Photography Explainable for Typhoon Damaged Feature

The improvement of the spatial resolution of natural images is an important task for many practical applications of current image processing. The endeavor of applying single image super-resolution, which only uses one low-resolution input image, is frequently hampered by the presence of noise or artifacts in the input image, so denoising and super-resolution algorithms are usually applied to obtain a noiseless high-resolution image. In this work, several traditional and deep learning methods for denoising and super-resolution are hybridized to ascertain which combinations of them yield the best possible quality. The experimental design includes the introduction of Gaussian noise, Poisson noise, salt-and-pepper noise, and uniform noise into the low-resolution inputs. It is found that denoising must be carried out before super-resolution for the best results. Moreover, the obtained results indicate that deep learning techniques clearly outperform the traditional ones.

Performance of Deep Learning and Traditional Techniques in Single Image Super-Resolution of Noisy Images

The classification performance of Convolutional Neural Networks (CNNs) can be hampered by several factors. Sensor noise is one of these nuisances. In this work, a study of the effect of noise on these networks is presented. The methodological framework includes two realistic models of noise for present day CMOS vision sensors. The models allow to include separately Poisson, Gaussian, salt \& pepper, speckle and uniform noise as sources of defects in image acquisition sensors. Then, synthetic noise may be added to images by using that methodology in order to simulate common sources of image distortion. Additionally, the impact of the brightness in conjunction with each selected kind of noise is also addressed. This way, the proposed methodology incorporates a brightness scale factor to emulate images with low illumination conditions. Based on these models, experiments are carried out for a selection of state of the art CNNs. The results of the study demonstrate that Poisson noise has a small impact on the performance of CNNs, while speckle and salt \& pepper noise together the global illumination level can substantially degrade the classification accuracy. Also, Gaussian and uniform noise have a moderate effect on the CNNs.

The effect of noise and brightness on convolutional deep neural networks

Noise which can appear in images affects the classification performance of Convolutional Neural Networks (CNNs). In particular, the impact of linear motion blur, which is one of the possible noises, in the classification performance of CNNs is assessed in this work. A realistic vision sensor model has been proposed to produce a linear motion blur effect in input images. This methodology allows analyzing how the performance of several considered state of the art CNNs is affected. Experiments that have been carried out indicate that the accuracy is heavily degraded by a high length of the displacement, while the angle of displacement deteriorates the performance to a lesser extent.

The impact of linear motion blur on the object recognition efficiency of deep convolutional neural networks

IML - International Workshop on Industrial Machine Learning

A network to solve the segmentation of ultra-high resolution images

UHRSNet: A Semantic Segmentation Network Specifically for Ultra-High-Resolution Images

AutoML and interpretability: Powering the Machine Learning Revolution in Healthcare in the Era of COVID-19 and Beyond

First-person-view (FPV) cameras are finding wide use in daily life to record activities and sports. In this presentation, I'm going to present a succinct and robust 3D convolutional neural network (CNN) architecture accompanied with an ensemble-learning network for activity recognition with FPV videos. The proposed 3D CNN is trained on low-resolution (32 x 32) sparse optical flows using FPV video datasets consisting of daily activities. According to the experimental results, our network achieves an average accuracy of 90%.

Activity Recognition Using First-Person-View Cameras Based on Sparse Optical Flows

This report summarises the Pollen Grain Classification Challenge 2020, and the related findings. It serves as an introduction to the technical reports that were submitted to the competition section at the 25th International Conference on Pattern Recognition (ICPR 2020), related to the Pollen Grain Classification Challenge.

Premium content

Modeling and Simulation Framework for Airborne Camera Systems

Downloads

Next from ICPR 2020

Local Anomaly Detection in Videos using Object-Centric Adversarial Learning

Similar lecture

Defect Detection of Stainless Steel Plates Using Deep Learning Technology