Brazil

Word embeddings is a text representation technique capable of capturing syntactic and semantic linguistic patterns and of representing each word as an n-dimensional dense vector. In the domain of legal texts, there are trained word embeddings in languages like English, Polish, and Chinese. However, to the best of our knowledge, there are no embeddings based on Portuguese (Brazilian and European) legal texts. Given that, our research question is: does the specificity and size of the text corpus used for a word embedding training contribute to a more successful classification? To answer the question, we train word embeddings models in the legal domain with different levels of specificity and size. Then we evaluate their impact on text classification. To deal with the different levels of specificity, we collect text documents from different courts of the Brazilian Judiciary, in hierarchical order. We used these text corpora to train a word embeddings model (GloVe) and then had then evaluated while classifying processes with a deep learning model (CNN). In a context perspective, the results show that in word embeddings trained on smaller corpora sizes, text specificity has a higher impact than for large sizes. Also, in a corpus size perspective, the results demonstrate that the greater the corpus size in embeddings training, the better are the results. However, this impact decreases as the corpus size increases until a point where more words in the corpus have little impact on the results.

BRACIS 2020

Impact of Text Specificity and Size on Word Embeddings Performance: an Empirical Evaluation in Brazilian Legal Domain

legal corpora

glove

convolutional neural network

word embeddings

text classification

stages 

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes, but also in industrial research departments and in technological startups. COLING conferences provide opportunities for all these communities to showcase their exciting developments.

COLING 2020

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

technical paper

The 9th Brazilian Conference on Intelligent Systems (BRACIS), the 16h Encontro Nacional de Inteligência Artificial e Computacional (ENIAC), and the 12th Concurso de Teses e Dissertações em Inteligência Artificial e Computacional (CTDIAC) was held from 20 to 23 October, 2020.

BRACIS originated from the combination of the two most important scientific events in Brazil in Artificial Intelligence (AI) and Computational Intelligence (CI): the Brazilian Symposium on Artificial Intelligence - SBIA (22 editions), and the Brazilian Symposium on Neural Networks - SBRN (13 editions). ENIAC is a national forum for researchers, practitioners, educators and students to present and discuss innovations, trends, experiences, developments and work in progress in the fields of Artificial and Computational Intelligence. CTDIAC is a satellite event whose goals are to disseminate and award the best dissertations and theses (MSc and PhDs concluded in Brazilian universities from June 2018 to May 2020) in Artificial and Computational Intelligence areas.

In this year, the Symposium on Knowledge Discovery, Mining and Learning (KDMiLe) will be held in conjunction with BRACIS 2020. This sysposium aims at integrating researchers, practitioners, developers, students and users to present their research results, to discuss ideas, and to exchange techniques, tools, and practical experiences – related to the Data Mining and Machine Learning areas.

An important challenge in the research field of Biometrics isreal-time identification, at a distance, in uncontrolled environments, us-ing low-resolution cameras. In such circumstances, soft biometrics can bethe only option. In this work, we propose two novel descriptor methodsfor biometric identification based on ensemble of anthropometric mea-surements and joints heat-map of the person skeleton, captured fromvideo frames through state-of-the-art 2D poses estimation methods. Theproposed methods were assessed on a popular benchmark dataset, CA-SIA Gait Dataset B, and obtained good results (85% and 89% of rank-1identification rates, respectively) with PifPaf 2D pose estimation method

People Identification Based on Soft BiometricsFeatures Obtained from 2D Poses

Colorectal cancer causes the deaths of thousands of people worldwide according to the World Health Organization. Automatic tissue recognition of histopathological images is essential for early disease diagnosis. Most research consists of employing texture descriptors to capture features that identify tumor samples. However, accurate multi-class classification is a challenge due to the complexity of colorectal tissue images. Recently, researchers have shown that the analysis of texture structural patterns degraded by image filtering provides valuable features for pre-diagnosis in several medical applications. Here we propose an approach to automatically classify eight types of colorectal tissues using Structural Co-occurrence Matrix. We carried on experiments on 5000 tissue patches from a public dataset to evaluate our algorithm, considering two scenarios: structural differences as a single descriptor, and combined with other characteristics. We found that our strategy improves the stateof-the-art, achieving, accuracy: 91.30%, precision: 91.41%, sensitivity: 91.31%, specificity: 98.76% e F1-score: 91.31%.

Texture analysis based on structural co-occurrence matrix improves the colorectal tissue characterization

Early diagnosis of genetic syndromes has a vital importance in the prevention of any potential related health problems. Down syndrome is the most common genetic syndrome. Patients with down syndrome have a high probability of developmental disorders, like Congenital Heart Disease, which is best treated when discovered in the early stages. These patients also have particular facial characteristics that are identified by geneticists in a physical exam. However, there is subjectivity in the professional analysis, which can lead to a late diagnosis, aggravating the patient's health condition. This paper proposes a software framework for the automatic detection of Down syndrome using facial features extracted from digital images, which could be used as a tool to help in the early detection of genetic syndromes. For training the machine learning model, we create a dataset gathering 170 pictures of children available on the internet. 50% of the pictures were of children with Down syndrome and the other 50% of healthy children. Then, we automatically identify faces and describe the images with facial landmarks. Next, we use two approaches for feature extraction. The first is a traditional computer vision approach using selected distances and angles and textures between the landmarks. The other, a deep learning approach using a Convolutional Neural Network to extract the features automatically. Then, the feature vector is fed to a Support Vector Machine with a linear kernel on both feature extraction approaches. We validate the results measuring the accuracy, sensitivity, and specificity of both feature extraction approaches using 10-fold cross-validation. The deep learning method resulted in an accuracy of 0.94, while the traditional approach achieved 0.84 of accuracy in our dataset. The results shows that the deep learning approach has a higher classification accuracy for this task, even with a small dataset.

A computational tool for automated detection of genetic syndrome using facial images

With the abundance of electronic lawsuits already implemented throughout Brazil, courts have a valuable source of information in text format that con-stitute attractive bases for the application of Artificial Intelligence (AI) and machine learning (ML). In this research, supervised learning approaches were explored for the automatic classification of types of documents in elec-tronic court proceedings of the Court of Justice of Minas Gerais (TJMG). The methodology is composed of cross-validation within the specific corpus of the legal domain, comparing traditional classifiers and more recent meth-ods based on neural networks and deep learning models, using Glove word vectors generated for the Portuguese Language and Convolutional Neural Network (CNN). This work achieved high precision in the results and if im-plemented in the courts it can provide significant savings in financial and human resources, allowing lawsuits classification activities, currently done manually by employees, to be performed in seconds by the machine. The re-sult of this experiment shows that the hit rates for the CNN and SVM classi-fiers exceed 93% and is considered a high result. Based on the assumption that Glove brings extra semantic resources that can help in classifying texts from court proceedings, this work demonstrates Glove's effectiveness by showing that a CNN with Glove surpasses SVM.

The use of machine learning in the classification of electronic lawsuits: an application in the Court of Justice of Minas Gerais

ICD coding from electronic clinical records is a manual, timeconsuming and expensive process. Code assignment is, however, an important task for billing purposes and database organization. While many works have studied the problem of automated ICD coding from free text using machine learning techniques, most use records in the English language, especially from the MIMIC-III public dataset. This work presents results for a dataset with Brazilian Portuguese clinical notes. We develop and optimize a Logistic Regression model, a Convolutional Neural Network (CNN), a Gated Recurrent Unit Neural Network and a CNN with Attention (CNN-Att) for prediction of diagnosis ICD codes. We also report our results for the MIMIC-III dataset, which outperform previous work among models of the same families, as well as the state of the art. Compared to MIMIC-III, the Brazilian Portuguese dataset contains far fewer words per document, when only discharge summaries are used. We experiment concatenating additional documents available in this dataset, achieving a great boost in performance. The CNN-Att model achieves
the best results on both datasets, with micro-averaged F1 score of 0.537 on MIMIC-III and 0.485 on our dataset with additional documents.


Predicting Multiple ICD-10 Codes from Brazilian Portuguese Clinical Notes

In this presentation, we will talk about the use of a semi-supervised technique called Randon Walk in Feature Sample Networks and the application of this technique in sentiment analysis of Portuguese tweets. We also present a change in the classification mechanism and the results found.

Semi-Supervised Sentiment Analysis of Portuguese Tweets with Random Walk in Feature Sample Networks

Automatic License Plate Recognition (ALPR) systems are used in many real-world applications, such as road traffic monitoring and traffic law enforcement, and the use of deep learning can result in efficient methods. In this work, we present an ALPR system efficient for edge computing, using a combination of MobileNet-SSD for vehicle detection, Tiny YOLOv3 for license plate detection and OCR-net for character recognition. This method was evaluated in two datasets on a NVIDIA Jetson TX2 system, obtaining 96.87% of accuracy and 8 FPS of framerate in a public real-world scenario dataset and achieving 90.56% of accuracy and 11 FPS of framerate in a private dataset of traffic monitoring images, considering the recognition of at least six characters. It is faster than related works with similar deep learning approaches, that achieved at most 2 FPS, and slightly inferior in accuracy, with less than 10% of difference in the worst scenario. This shows the proposed method is well balanced between accuracy and speed, thus, suitable for embedded devices.

A Robust Automatic License Plate Recognition System for Embedded Devices

Phonetic analysis of speech, in general, requires the alignment of audio samples to its phonetic transcription. This task could be performed manually for a couple of files, but as the corpus grows large it becomes unfeasibly time-consuming, which emphasizes the need for computational tools that perform such speech-phonemes forced alignment automatically. Therefore, due to the scarce availability of phonetic alignment tools for Brazilian Portuguese (BP), this work describes the evolution process towards creating a free phonetic alignment tool for BP using Kaldi, a toolkit that has been the state of the art for open-source speech recognition. Five acoustic models were trained with Kaldi and tested in phonetic alignment, where the evaluation took place in terms of the phone boundary metric. The results show that its performance is similar to some Kaldi-based aligners for other languages and superior to an outdated phonetic aligner for BP based on HTK toolkit.


Towards a Free, Forced Phonetic Aligner for Brazilian Portuguese Using Kaldi Tools

An efficient way to deal with classification problems is by using Fuzzy Rule-Based Classification Systems. A key point in this kind of classifier is the Fuzzy Reasoning Method (FRM). This mechanism is responsible for performing the classification of examples into predefined classes. There are different generalizations of the Choquet integral in the literature that are applied in the FRM. This paper presents an initial study of a new FRM that is ensemble-based, which combines different generalizations in a more effective final classifier. We have constructed two distinct ensemble decision-making methods considering the majority and weighted voting approaches. The experimental results demonstrate that the performance of the proposed methods is statistically equivalent compared to the state-of-art generalizations.

A Fuzzy Reasoning Method based on ensembles of generalizations of the Choquet integral

In social simulation, agents play different roles with different behaviors. Each has its goals and can cooperate or not with others and consume resources. Sometimes it is necessary to regulate these agents with mechanisms like norms that explain action limitations and how the society works for the agents. To explain how the world works for the agents, in different domains, ontologies have been used to provide human knowledge. In this sense, a more special kind of ontology is built with the legal information of a society: legal ontologies. These legal ontologies operate with concepts and data collected from human society and this can be provided to the agents. With this type of information, the agents can be assisted in monitoring and evaluating actions, comparing their beliefs with existing laws. Platforms into programming multi-agent systems provide an environment to develop the social simulations, but not always provided a connection with ontologies resources. This study proposes the AgentDevLaw middleware that integrates platforms of agents’ simulation with an existent legal ontology. The application of the software component is exemplified and tested with simulation scenarios in two agent’s environments: JaCaMo and JADE.

Downloads

Next from BRACIS 2020

People Identification Based on Soft BiometricsFeatures Obtained from 2D Poses

Similar lecture

An Empirical Study of the Downstream Reliability of Pre-Trained Word Embeddings

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from BRACIS 2020

People Identification Based on Soft BiometricsFeatures Obtained from 2D Poses

Similar lecture

An Empirical Study of the Downstream Reliability of Pre-Trained Word Embeddings

Downloads