Imputation of Data Missing Not at Random: artificial generationand benchmark analysis
A carregar...
Ficheiros
Data
2024-09-01
Autores
Pereira, Ricardo Cardoso
Abreu, Pedro Henriques
Rodrigues, Pedro Pereira
Figueiredo, Mário A. T.
Título da revista
ISSN da revista
Título do Volume
Editora
Elsevier
Resumo
Experimental assessment of different missing data imputation methods often compute error rates between the original values and the estimated ones. This experimental setup relies on complete datasets that are injected with missing values. The injection process is straightforward for the Missing Completely At Random and Missing At Random mechanisms; however, the Missing Not At Random mechanism poses a major challenge, since the available artificial generation strategies are limited. Furthermore, the studies focused on this latter mechanism tend to disregard a comprehensive baseline of state-of-the-art imputation methods. In this work, both challenges are addressed: four new Missing Not At Random generation strategies are introduced and a benchmark study is conducted to compare six imputation methods in an experimental setup that covers 10 datasets and five missingness levels (10% to 80%). The overall findings are that, for most missing rates and datasets, the best imputation method to deal with Missing Not At Random values is the Multiple Imputation by Chained Equations, whereas for higher missingness rates autoencoders show promising results.
Descrição
Palavras-chave
Citação
Ricardo Cardoso Pereira, Pedro Henriques Abreu, Pedro Pereira Rodrigues, Mário A.T. Figueiredo, Imputation of Data Missing Not at Random: artificial generation and benchmark analysis, Expert Systems with Applications, Volume 249, Part B, 2024, 123654, ISSN 0957-4174, https://doi.org/10.1016/j.eswa.2024.123654