Italy

The ability to detect objects in cultural sites from the egocentric point of view of the user can enable interesting applications for both the visitors and the manager of the site. Unfortunately, current object detection algorithms have to be trained on large amounts of labeled data, the collection of which is costly and time-consuming. While synthetic data generated from the 3D model of the cultural site can be used to train object detection algorithms, a significant drop in performance is generally observed when such algorithms are deployed to work with real images. In this paper, we consider the problem of unsupervised domain adaptation for object detection in cultural sites. Specifically, we assume the availability of synthetic labeled images and real unlabeled images for training. To study the problem, we propose a dataset containing 75244 synthetic and 2190 real images with annotations for 16 different artworks. We hence investigate different domain adaptation techniques based on image-to-image translation and feature alignment. Our analysis points out that such techniques can be useful to address the domain adaptation issue, while there is still plenty of space for improvement on the proposed dataset. We release the dataset at our web page to encourage research on this challenging topic:
https://iplab.dmi.unict.it/EGO-CH-OBJ-ADAPT/.

ICPR 2020

Unsupervised Domain Adaptation For Object Detection in Cultural Sites

cultural sites

object detection

domain adaptation

ICPR 2020 is the premier international conference on Pattern Recognition, gathering leading researchers from around the world to present their latest achievements in Pattern Analysis and Recognition, applied Artificial Intelligence and Machine Learning. The topic of the year is " Putting Artificial intelligence to work on Patterns". 
For the first time, ICPR has employed a two-round review process similar to journal submissions, with new papers allowed to be submitted in either the first or second round and papers submitted in the first round and not accepted allowed to be revised and re-submitted for second round review. 

In this edition of the **ICPR 2020** Conference, there are 1407 Oral/Poster presentations organized in five Tracks: 
- Artificial Intelligence, Machine Learning for Pattern Analysis; 
- Biometrics, Human Analysis and Behavior Understanding; Computer Vision, Robotics and Intelligent Systems; 
- Document and Media Analysis; and 
- Image and Signal Processing. 

The **ICPR 2020** Main Conference program also includes 7 Keynotes from prominent world-renowned scientists, 8 Tutorials, 28 Demos, 8 Challenges, 2 Panels, as well as an Industry/Sponsor Exhibition. In addition, 41 Workshops on a range of important current and emerging research topics complete the ICPR 2020 program. 


technical paper

We propose a novel evaluation metric for generating models. We leverage siamese architecture and train our discriminator on the real dataset. We define a loss function that takes advantage of the fact that the discriminator's target features should be close to each other when their input is from the same category.

On the Evaluation of Generative Adversarial Networks By Discriminative Models

We propose Fast Direction-Search-Based Subspace Clustering (Fast DiSC), a scalable and robust framework for large scale clustering that rests upon representations derived from projections on computed data-dependent directions. To advance scalability, a Direction Search in Data Partitions (DiSPart) procedure performs direction-search in small partitions of sampled data, followed by retrieval using Retrieval using Direction-based Projections (ReDiP) to cluster out-of-sample data using projections on the computed directions and the associated clustering. A theoretical study establishes the correctness of the direction-based clustering framework and that of direction-search in small partitions. In turn, Fast DiSC can provably realize substantial speedups while maintaining high accuracy.

Scalable Direction-Search-Based Approach to Subspace Clustering


This paper studies the problem of Person Re-Identification (ReID)
for large-scale applications. Recent research efforts have been devoted
to building complicated part models, which introduce considerably
high computational cost and memory consumption, inhibiting its practicability
in large-scale applications. This paper aims to develop a novel learning
strategy to find efficient feature embeddings while maintaining the
balance of accuracy and model complexity. More specifically, we find
by enhancing the classical triplet loss together with cross-entropy
loss, our method can explore the hard examples and build a discriminant
feature embedding yet compact enough for large-scale applications.
Our method is carried out progressively using Bayesian optimization,
and we call it the Progressive Learning Algorithm (PLA). Extensive
experiments on three large-scale datasets show that our PLA is comparable
or better than the state-of-the-arts. Especially, on the challenging
Market-1501 dataset, we achieve Rank-1=94.7%/mAP=89.4% while saving
at least 30\% parameters than strong part models.

Efficient Online Subclass Knowledge Distillation for Image Classification

Fourier Domain Pruning of MobileNet-V2 with Application to Video Based Wildfire Detection

We propose a novel network initialization method using Perlin noise for training image classification networks with a limited amount of data. Our main idea is to initialize the network parameters by solving an artificial noise classification problem, where the aim is to classify Perlin noise samples into their noise categories. Specifically, the proposed method consists of two steps. First, it generates Perlin noise samples with category labels defined based on noise complexity. Second, it solves a classification problem, in which network parameters are optimized to classify the generated noise samples. This method produces a reasonable set of initial weights (filters) for image classification. To the best of our knowledge, this is the first work to initialize networks by solving an artificial optimization problem without using any real-world images. Our experiments show that the proposed method outperforms conventional initialization methods on four image classification datasets.

Initialization Using Perlin Noise for Training Networks with a Limited Amount of Data


Accurate segmentation for lung nodules in lung computed tomography (CT) scans plays a key role in the early diagnosis of lung cancer. In this work, we propose a novel Mask and Texture-driven Generative Adversarial Network (MTGAN) with a joint multi-scale L1 loss for lung nodule segmentation, which takes full advantages of U-Net and adversarial training. The proposed MTGAN leverages adversarial learning strategy guided by the boundary and texture information of lung nodules to generate more accurate segmentation results with lesser false positives.

MTGAN: Mask and Texture-driven Generative Adversarial Network for Lung Nodule Segmentation

Since the poor performance of Faster R-CNN in dense scenes. We propose a straightforward sampling method, which helps to elevate the ratio of positive samples. By assigning a positive label to more anchors in three steps according to different rules, we increase the number of positive samples and reduce the waste of ground-truth. The experiments prove that the performance of our method reaches nearly the existing state-of-the-art with faster inference speed.

Multiple-step Sampling for Dense Object Detection and Counting


In an ECG record, the PQRST waves are of important medical significance which provide ample information reflecting heartbeat activities. In this paper, we propose a novel arrhythmia classification method namely EasiECG, characterized by simplicity and accuracy. Compared with other works, the EasiECG takes the configuration of these five key waves into account and does not require complicated feature engineering. Meanwhile, an additional encoding of the extracted features makes the EasiECG applicable even on samples with missing waves. To automatically capture interactions that contribute to the classification among the processed features, a novel adapted classification model named Attention-based Convolution Factorization Machines (ACFM) is proposed. Extensive experiments show that our method is competitive compared with other state-of-the-arts.

EasiECG: A Novel Inter-Patient Arrhythmia Classification Method using ECG Waves

We present a novel technique called a q-Gaussian distributed stochastic neighbor embedding (q-SNE) to improve t-distributed stochastic neighbor embedding (t-SNE). The q-SNE uses q-Gaussian distribution instead of t-distribution of t-SNE.
Since the q-Gaussian distribution includes Gaussian distribution, t-distribution, and others, so the q-SNE leads to more powerful and flexible visualization on 2 or 3-dimensional mapping than the t-SNE.

q-SNE: Visualizing Data using q-Gaussian distributed Stochastic Neighbor Embedding

Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (UDA), several studies on semi-supervised DA (SSDA) are recently suggested. In SSDA, a small number of labeled target images are given for training, and the effectiveness of those data is demonstrated by the previous studies. However, the previous SSDA approaches solely adopt those data for embedding ordinary supervised losses, overlooking the potential usefulness of the few yet informative clues. Based on this observation, in this paper, we propose a novel method that further exploits the labeled target images for SSDA. Specifically, we utilize labeled target images to selectively generate pseudo labels for unlabeled target images. In addition, based on the observation that pseudo labels are inevitably noisy, we apply a label noise-robust learning scheme, which progressively updates the network and the set of pseudo labels by turns. Extensive experimental results show that our proposed method outperforms other previous state-of-the-art SSDA methods.

Premium content

Unsupervised Domain Adaptation For Object Detection in Cultural Sites

Downloads

Next from ICPR 2020

On the Evaluation of Generative Adversarial Networks By Discriminative Models

Similar lecture

Unsupervised Domain Adaptation For Object Detection in Cultural Sites