Please use this identifier to cite or link to this item:
Title: When Two are Better Than One: Synthesizing Heavily Unbalanced Data
Authors: Ferreira, Francisco 
Lourenço, Nuno 
Cabral, Bruno 
Fernandes, João Paulo 
Keywords: Fraud detection; generative adversarial networks; privacy; machine learning; synthetic data generation; tabular data
Issue Date: 2021
Project: FCT - UID/CEC/00326/2020 
European Social Fund, through the Regional Operational Program Centro 2020; and in part by the Carnegie Mellon University (CMU)|Portugal Project autonomiC plAtform for MachinE Learning using anOnymized daTa (CAMELOT) under Grant POCI-01-0247-FEDER-045915 
Serial title, monograph or event: IEEE Access
Volume: 9
Abstract: Nowadays, data is king and if treated and used properly it promises to give organizations a competitive edge over rivals by enabling them to develop and design Intelligent Systems to improve their services. However, they need to fully comply with not only ethical but also regulatory obligations, where, e.g., privacy (strictly) needs to be respected when using or sharing data, thus protecting both the interests of users and organizations. Fraud Detection systems are examples of such systems where Machine Learning algorithms leverage information to classify nancial transactions as legitimate or illicit. The data used to create these solutions is usually highly structured and contains categorical and continuous features characterised by complex distributions. One of the main challenges of fraud detection is concerned with the scarcity of fraudulent instances which results in highly unbalanced datasets. Additionally, privacy is crucial, and it is usually forbidden, or not possible, to share the data of organizations and individuals for creating or improving models. In this paper we propose a framework for private data sharing based on synthetic data generation using Generative Adversarial Networks (GAN) that learns the speci cities of nancial transactions data and generates ctitious data that keeps the utility of the original datasets. Our proposal, called Duo-GAN, uses two GAN generators to handle the data imbalance problem, one generator for fraudulent instances and the other for legitimate instances. With this approach, we observed, at most, a 5% disparity in F1 scores between classi ers trained and tested with actual data and the ones trained with synthetic data and tested with actual data.
ISSN: 2169-3536
DOI: 10.1109/ACCESS.2021.3126656
Rights: openAccess
Appears in Collections:I&D CISUC - Artigos em Revistas Internacionais

Files in This Item:
Show full item record


checked on May 2, 2023

Page view(s)

checked on Nov 28, 2023


checked on Nov 28, 2023

Google ScholarTM




This item is licensed under a Creative Commons License Creative Commons