Abstract
In data-processing pipelines, upstream steps can influence downstream processes because of their sequential nature. Among these data-processing steps, batch effect (BE) correction (BEC) and missing value imputation (MVI) are crucial for ensuring data suitability for advanced modeling and reducing the likelihood of false discoveries. Although BEC–MVI interactions are not well studied, they are ultimately interdependent. Batch sensitization can improve the quality of MVI. Conversely, accounting for missingness also improves proper BE estimation in BEC. Here, we discuss how BEC and MVI are interconnected and interdependent. We show how batch sensitization can improve any MVI and bring attention to the idea of BE-associated missing values (BEAMs). Finally, we discuss how batch-class imbalance problems can be mitigated by borrowing ideas from machine learning.
Original language | English |
---|---|
Article number | 103661 |
Journal | Drug Discovery Today |
Volume | 28 |
Issue number | 9 |
DOIs | |
Publication status | Published - Sept 2023 |
Externally published | Yes |
Bibliographical note
Publisher Copyright:© 2023 Elsevier Ltd
ASJC Scopus Subject Areas
- Pharmacology
- Drug Discovery
Keywords
- batch effects
- class-batch proportion imbalance
- computational biology
- confounding
- data science
- missing value imputation
- statistics