How missing value imputation is confounded with batch effects and what you can do about it

Wilson Wen Bin Goh*, Harvard Wai Hann Hui, Limsoon Wong

*Corresponding author for this work

Research output: Contribution to journalShort surveypeer-review

4 Citations (Scopus)

Abstract

In data-processing pipelines, upstream steps can influence downstream processes because of their sequential nature. Among these data-processing steps, batch effect (BE) correction (BEC) and missing value imputation (MVI) are crucial for ensuring data suitability for advanced modeling and reducing the likelihood of false discoveries. Although BEC–MVI interactions are not well studied, they are ultimately interdependent. Batch sensitization can improve the quality of MVI. Conversely, accounting for missingness also improves proper BE estimation in BEC. Here, we discuss how BEC and MVI are interconnected and interdependent. We show how batch sensitization can improve any MVI and bring attention to the idea of BE-associated missing values (BEAMs). Finally, we discuss how batch-class imbalance problems can be mitigated by borrowing ideas from machine learning.

Original languageEnglish
Article number103661
JournalDrug Discovery Today
Volume28
Issue number9
DOIs
Publication statusPublished - Sept 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2023 Elsevier Ltd

ASJC Scopus Subject Areas

  • Pharmacology
  • Drug Discovery

Keywords

  • batch effects
  • class-batch proportion imbalance
  • computational biology
  • confounding
  • data science
  • missing value imputation
  • statistics

Fingerprint

Dive into the research topics of 'How missing value imputation is confounded with batch effects and what you can do about it'. Together they form a unique fingerprint.

Cite this