Development of a Highway Tolling and Enforcement System Using Convolutional Neural Networks and Fine-Grained Visual Classification

Abstract

Deep Learning and Convolutional Neural Networks have been staples in solving challenges relatedto Image Processing, Computer Vision and Pattern Recognition. Since their breakthrough in 2012 thatno other method has come close, be it in overall results, consistency, but also computation capabilities,with the technology evolving and delivering more and more impressive results as framework developerspush the boundaries. As a consequence, we are seeing work in the domain of Deep Learning creepmore and more in our ever day lives, automating a variety of tasks.In this work, Deep Learning will be applied to try and automate one such barely noticed task: tollcollection. In Porugal, Brisa operates an automatic toll collection service, which despite their bestefforts, is still fragile and subject to fraud. It is then in their interest that toll collection becomesas precise and reliable as possible. With this in mind, this document explores technology relatedto Vehicle Recognition, and applies state-of-the-art methodologies that ultimately deliver a solutionthat performs with state-of-the-art competitive results. The methodologies here applied can easily bereplicated and should translate well to other critical aspects of social life, like medical imaging baseddiagnosing.This work was submitted for the partial fulfillment of the requirements to complete the Integrated Master in Electrical and Computer Engineering, Automation Specialization, on October 2020. The work was supervised by Professor Jorge Manuel Moreira de Campos Pereira Batista, Phd.

Deep Learning and Convolutional Neural Networks have been staples in solving challenges relatedto Image Processing, Computer Vision and Pattern Recognition. Since their breakthrough in 2012 thatno other method has come close, be it in overall results, consistency, but also computation capabilities,with the technology evolving and delivering more and more impressive results as framework developerspush the boundaries. As a consequence, we are seeing work in the domain of Deep Learning creepmore and more in our ever day lives, automating a variety of tasks.In this work, Deep Learning will be applied to try and automate one such barely noticed task: tollcollection. In Porugal, Brisa operates an automatic toll collection service, which despite their bestefforts, is still fragile and subject to fraud. It is then in their interest that toll collection becomesas precise and reliable as possible. With this in mind, this document explores technology relatedto Vehicle Recognition, and applies state-of-the-art methodologies that ultimately deliver a solutionthat performs with state-of-the-art competitive results. The methodologies here applied can easily bereplicated and should translate well to other critical aspects of social life, like medical imaging baseddiagnosing.This work was submitted for the partial fulfillment of the requirements to complete the Integrated Master in Electrical and Computer Engineering, Automation Specialization, on October 2020. The work was supervised by Professor Jorge Manuel Moreira de Campos Pereira Batista, Phd.