kNNSampler: Stochastic imputations for recovering missing value distributions

Pashmchi, Parastoo; Benoit, Jéröme; Kanagawa, Motonobu
Submitted to ArXiV, 10 September 2025

We study a missing-value imputation method, termed kNNSampler, that imputes a given unit's missing response by randomly sampling from the observed responses of the  most similar units to the given unit in terms of the observed covariates. This method can sample unknown missing values from their distributions, quantify the uncertainties of missing values, and be readily used for multiple imputation. Unlike popular kNNImputer, which estimates the conditional mean of a missing response given an observed covariate, kNNSampler is theoretically shown to estimate the conditional distribution of a missing response given an observed covariate. Experiments demonstrate its effectiveness in recovering the distribution of missing values. The code for kNNSampler is made publicly available (this https URL).


Type:
Report
Date:
2025-09-10
Department:
Data Science
Eurecom Ref:
8380
Copyright:
© EURECOM. Personal use of this material is permitted. The definitive version of this paper was published in Submitted to ArXiV, 10 September 2025 and is available at :

PERMALINK : https://www.eurecom.fr/publication/8380