Please use this identifier to cite or link to this item:
Title: User-Driven Fine-Tuning for Beat Tracking
Authors: Pinto, António
Böck, Sebastian
Cardoso, Jaime
Davies, Matthew
Keywords: Beat tracking; Transfer learning; User adaptation
Issue Date: 2021
Publisher: MDPI
Project: IF/01566/2015 
Serial title, monograph or event: Electronics (Switzerland)
Volume: 10
Issue: 13
Abstract: The extraction of the beat from musical audio signals represents a foundational task in the field of music information retrieval. While great advances in performance have been achieved due the use of deep neural networks, significant shortcomings still remain. In particular, performance is generally much lower on musical content that differs from that which is contained in existing annotated datasets used for neural network training, as well as in the presence of challenging musical conditions such as rubato. In this paper, we positioned our approach to beat tracking from a real-world perspective where an end-user targets very high accuracy on specific music pieces and for which the current state of the art is not effective. To this end, we explored the use of targeted fine-tuning of a state-of-the-art deep neural network based on a very limited temporal region of annotated beat locations. We demonstrated the success of our approach via improved performance across existing annotated datasets and a new annotation-correction approach for evaluation. Furthermore, we highlighted the ability of content-specific fine-tuning to learn both what is and what is not the beat in challenging musical conditions.
ISSN: 2079-9292
DOI: 10.3390/electronics10131518
Rights: openAccess
Appears in Collections:I&D CISUC - Artigos em Revistas Internacionais

Files in This Item:
File Description SizeFormat
electronics-10-01518 (1).pdf1.5 MBAdobe PDFView/Open
Show full item record


checked on Jul 2, 2022

Page view(s)

checked on Jul 1, 2022


checked on Jul 1, 2022

Google ScholarTM




This item is licensed under a Creative Commons License Creative Commons