Italy

This presentation introduces a highly efficient image retrieval technique called DCNN-vForest (Decomposition Convolution Neural Network and vocabulary Forest), which aims to retrieve the relevant images to the given image query by studying the correlation between images in the image database based on decomposition. The regional and global features of the image database are first extracted using the convolution neural network, and then divided into clusters of similar images using the Kmeans algorithm. We propose a new structure called vForest (vocabulary Forest), by calculating the vocabulary tree on each cluster of images. The retrieval process benefits from the knowledge provided by the vForest, and instead of considering the whole image database, only the most similar cluster to the image query is explored. To demonstrate the usefulness of our approach, intensive experiments have been carried out on ground-truth image databases, the results reveal the superiority of DCNN-vForest against the baseline image retrieval solutions, in terms of runtime and accuracy.

ICPR 2020

Hybrid Decomposition Convolution Neural Network and Vocabulary Forest for Image Retrieval

convolution neural network

bag of words

image retrieval

ICPR 2020 is the premier international conference on Pattern Recognition, gathering leading researchers from around the world to present their latest achievements in Pattern Analysis and Recognition, applied Artificial Intelligence and Machine Learning. The topic of the year is " Putting Artificial intelligence to work on Patterns". 
For the first time, ICPR has employed a two-round review process similar to journal submissions, with new papers allowed to be submitted in either the first or second round and papers submitted in the first round and not accepted allowed to be revised and re-submitted for second round review. 

In this edition of the **ICPR 2020** Conference, there are 1407 Oral/Poster presentations organized in five Tracks: 
- Artificial Intelligence, Machine Learning for Pattern Analysis; 
- Biometrics, Human Analysis and Behavior Understanding; Computer Vision, Robotics and Intelligent Systems; 
- Document and Media Analysis; and 
- Image and Signal Processing. 

The **ICPR 2020** Main Conference program also includes 7 Keynotes from prominent world-renowned scientists, 8 Tutorials, 28 Demos, 8 Challenges, 2 Panels, as well as an Industry/Sponsor Exhibition. In addition, 41 Workshops on a range of important current and emerging research topics complete the ICPR 2020 program. 


poster

Dear sir or madam:
My name is chenshannan, a master student in the Key Lab of Advanced Design and Intelligent Computing of Dalian University. My recent research interest include image classification and deep learning. I feel very honored to accepted by ICPR. The following i will simply Introduce my related work in four aspects.

Recently, modeling deep convolutional activations by the global second-order pooling has shown great advance on visual recognition tasks. However, most of the existing deep second-order statistical models mainly compute second-order statistics of activations of the last convolutional layer as image representations, and they seldom introduce second-order statistics into earlier layers to better fit network topology, thus limiting the representational ability to a certain extent. 

The main contributions of our paper are summarized as follows: 
A novel Second-order Attention Guided Network (SoAG-Net) is proposed for visual recognition in an end-to-end.Ours model involves a group of SoAG modules seemingly inserted into intermediate layers of deep convolutional networks.Ours model captures second-order statistics of activations to predict attention map used for guiding the learning of networks.

We also use cifar and The Street View House Numbers dataset in our Experiments.
we presented a novel second-order attention guided network (SoAG-Net), which contains conceptually simple yet effective modules conveniently plugged into earlier residual stages of ConvNet. Ours module non-trivially guides the learning of convolutional activations by attention map computed from second-order statistics of activations themselves. With such module throughout a network, SoAG-Net simultaneously gets stronger representation power and provides more nonlinearity.

Second-order Attention Guided Convolutional Activations for Visual Recognition

We propose a new type of network (AWNet) to realize the style transfer task from visible images to Chinese traditional paintings. We add the low-frequency part of wavelet transform to add the corresponding "traditional painting" style to the network base on CycleGAN. Moreover, the high frequencies and the corresponding attention mechanism are used to enhance the detail information.

Attentional Wavelet Network for Traditional Chinese Paintings Transfer


Convolutional Neural Networks (CNNs) are widely used due to their high performance in many tasks related to computer vision. In particular, image classification is one of the fields where CNNs are employed with success. However, images can be heavily affected by several inconveniences such as noise or illumination. Therefore, image enhancement algorithms have been developed to improve the quality of the images. In this work, the impact that brightness and image contrast enhancement techniques have on the performance achieved by CNNs in classification tasks is analyzed. More specifically, several well known CNNs architectures such as Alexnet or Googlenet, and image contrast enhancement techniques such as Gamma Correction or Logarithm Transformation are studied. Different experiments have been carried out, and the obtained qualitative and quantitative results are reported.

The effect of image enhancement algorithms\\on convolutional neural networks

The achievement of neural networks in a variety of applications is accompanied by a dramatic increase in computational costs and memory requirements. In this paper, we propose an efficient method to simultaneously identify the critical neurons and prune the model during training without involving any pre-training or fine-tuning procedures. Unlike existing methods, which accomplish this task in a greedy fash- ion, we propose a majority voting technique to compare the activation values among neurons and assign a voting score to quantitatively evaluate their importance. This mechanism helps to effectively reduce model complexity by eliminating the less influential neurons and aims to determine a subset of the whole model that can represent the reference model with much fewer parameters within the training process. Experimental results show that majority voting efficiently compresses the network with no drop in model accuracy, pruning more than 79% of the original model parameters on CIFAR10 and more than 91% of the original parameters on MNIST. Moreover, we show that with our proposed method, sparse models can be further pruned into even smaller models by removing more than 60% of the parameters, whilst preserving the reference model accuracy.

Neuron-based Network Pruning Based on Majority Voting

We propose a machine learning based approach for automatic regularization and polygonization of building segmentation masks. Taking an image as input, we first predict building segmentation maps exploiting generic fully convolutional network (FCN). A generative adversarial network (GAN) is then involved to perform a regularization of building boundaries to make them more realistic, i.e., having more rectilinear outlines which construct right angles if required. This is achieved through the interplay between the discriminator which gives a probability of input image being true and generator that learns from discriminator's response to create more realistic images. Finally, we train the backbone convolutional neural network (CNN) which is adapted to predict sparse outcomes corresponding to building corners out of regularized building segmentation results. Experiments on three building segmentation datasets demonstrate that the proposed method is not only capable of obtaining accurate results, but also of producing visually pleasing building outlines parameterized as polygons.

Machine-learned Regularization and Polygonization of Building Segmentation Masks


Homography estimation from a pair of natural images is a problem of paramount importance for computer vision. Specialized deep convolutional neural networks have been proposed to accomplish this task. In this work, a method to enhance the result of this kind of homography estimators is proposed. Our approach generates a set of tentative color transformations for the image pair. Then the color transformed image pairs are evaluated by a regressor that estimates the quality of the homography that would be obtained by supplying the transformed image pairs to the homography estimator. Then the image pair that is predicted to yield the best result is provided to the homography estimator. Experimental results are shown, which demonstrate that our approach performs better than the direct application of the homography estimator to the original image pair, both in qualitative and quantitative terms.

Adaptive estimation of optimal color transformations for deep convolutional network based homography estimation


Manipulation and re-use of images in scientific publications is a growing issue, not only for biomedical publishers but also for the research community in general. In this work, we introduce BINDER – Bio-Image Near-Duplicate Examples Repository, a novel dataset to help researchers develop, train, and test models to detect same-source biomedical images. We further use the dataset to demonstrate how novel adaptations of existing image retrieval and metric learning models can be applied to achieve high-accuracy inference results, creating a baseline for future work. In aggregate, we thus present a supervised protocol for near-duplicate image identification and retrieval without any “real-world” training example.

On Identification and Retrieval of Near-Duplicate Biological Images: a New Dataset and Protocol


With the development of the Internet and the globalization of economy, transforming text images to understandable information automatically has become an intense demand.
To the best of our knowledge, all schemes for handling this problem are separating it into two parts, Mono-Lingual Text Image Recognition (MLTIR) and machine translation (MT), illustrated in the Figure.
Nevertheless, this kind of apart system is potentially error prone.
Inspired by the above observations, we propose a novel end-to-end method for Cross Lingual Text Image Recognition.

Cross-Lingual Text Image Recognition via Multi-Task Sequence to Sequence Learning


Gaining control over the dynamics of multi-task learning should help to unlock the potential of the deep network to a great extent. In the existing multi-task learning (MTL) approaches of a deep network, all the parameters of its feature encoding part are subjected to adjustments corresponding to each of the underlying sub-tasks. On the other hand, different functional areas of the human brain are responsible for distinct functions such as the Broca's area of the cerebrum is responsible for speech formation whereas its Wernicke's area is related to the language development etc. Inspired by this fact, in the present study, we used here a Feature Representation Block (FRB) of connection weights spanned over a few successive layers of a deep multi-task learning architecture and stratify the same into distinct subsets for their adjustments exclusively corresponding to different sub-tasks. Additionally, we have introduced a novel regularization component for controlled training of this Feature Representation Block. The purpose of the development of this learning framework is efficient end-to-end recognition of scene texts.

Stratified Multi-Task Learning for Robust Spotting of Scene Texts


We propose a method for Offline Handwritten Mathematical Expression recognition. The method is a fast and accurate thanks to its architecture, which include both a Convolutional Neural Network and a Recurrent Neural Network. The CNN extracts features from the image to recognize and its output is provided to the RNN which produces the mathematical expression encoded in the LaTeX language.
To process both sequential and non-sequential mathematical expressions we also included a deconvolutional module which, in a recursive way, segments the image for additional analysis trough a recursive process. The results obtained show a very high accuracy obtained on a large handwritten data set of 9100 samples of handwritten expressions.

Premium content

Hybrid Decomposition Convolution Neural Network and Vocabulary Forest for Image Retrieval

Downloads

Next from ICPR 2020

Second-order Attention Guided Convolutional Activations for Visual Recognition

Similar lecture

Rotation Invariant Aerial Image Retrieval with Group Convolutional Metric Learning