ThermalEdge: Uma solução em hardware para o reconhecimento de embriaguez em tempo real a partir de imagens térmicas utilizando edge computing

Abstract

Alcohol consumption has presented problems for road safety, traffic enforcement can benefit from the development of methods for classifying the individual's status. In this way, recent advances in thermography associated with the advent of 5G, resulted in new opportunities for study, such as computing at the performed at the edge of the network and the use of deep neural network algorithms in microcomputers. The objective of this master's project is the development of a framework that allows the classification of thermal images, for the labeling of the individual's state in real-time, captured by a thermal camera coupled to a cellular device that sends the images to a server at the edge of the network that has a convolutional neural network model trained to recognize the individual's state from thermal images. In addition, for detecting drunkenness, hardware accelerators are used in embedded devices. In addition, an application for mobile devices was developed to allow the sending of images in real-time for classification, using the UDP protocol. Because of this, for the proposed framework to recognize the drunken state, a convolutional neural network model was trained using transfer learning to abstract characteristics related to drunkenness. The model trained for the Edge TPU obtained the best accuracy in the classification of inebriation, which was 94.33% in the test set.