Please use this identifier to cite or link to this item: http://hdl.handle.net/10316/100882
Title: A Reinforcement Learning Assisted Eye-Driven Computer Game Employing a Decision Tree-Based Approach and CNN Classification
Authors: Perdiz, João 
Garrote, Luís 
Pires, Gabriel Pereira 
Nunes, Urbano J. 
Keywords: CNN; decision tree; electrooculography; reinforcement learning
Issue Date: 2021
Serial title, monograph or event: IEEE Access
Volume: 9
Abstract: Human-Machine Interfaces employing biosignal-based inputs are hard to translate to real-life applications, in part because of the difficulty of developing generalized models to classify physiological events representing a user's actions. In the proposed framework, an Electrooculography (EOG)-based game is operated through a pipeline of decision methods. These include a user-independent classification model of eye movements using a Convolutional Neural Network (CNN), which is fed with images created from signal windows, and an Ensemble of Utility Decision Networks (EUDN), which moderates the impact of oftentimes conflicting ocular events while enabling a more natural level of control over the interface. The CNN and the EUDN replace the normally used feature-based ocular event detection methods for EOG. Finally, a Reinforcement Learning-based game actuation approach simultaneously updates multiple (State, Action) pairs for each rewarded outcome, intervenes to mitigate the consequences of wrongful game Commands, and can be used as part of a "shared-control"paradigm based on EOG. Results show a positive impact of Reinforcement Learning both in improving participants' game performance as well as in reducing some of their subjective workload indicators.
URI: http://hdl.handle.net/10316/100882
ISSN: 2169-3536
DOI: 10.1109/ACCESS.2021.3068055
Rights: openAccess
Appears in Collections:FCTUC Eng.Electrotécnica - Artigos em Revistas Internacionais
I&D ISR - Artigos em Revistas Internacionais

Show full item record

Google ScholarTM

Check

Altmetric

Altmetric


This item is licensed under a Creative Commons License Creative Commons