Overview

Imbalanced data occurs when the number of samples in one class far exceeds the others — a pervasive challenge in biomedical research. Disease prevalence is typically low, so datasets contain far more healthy controls than cases; adverse drug reactions are rare; and functional genomic elements are sparse across the genome. Standard classifiers trained on imbalanced data tend to favor the majority class, achieving high accuracy by simply predicting the most common label while missing the minority class entirely. Specialized techniques are required to produce models that detect the rare but important events.

Methods

Data-level approaches modify the training set distribution. Random undersampling removes majority-class samples but risks discarding useful information. Synthetic Minority Over-sampling Technique (SMOTE) generates synthetic minority samples by interpolating between existing minority instances. Algorithm-level approaches adjust the learning process: class-weighting assigns higher penalties to minority misclassifications in the loss function, and cost-sensitive learning incorporates misclassification costs directly. Ensemble methods such as balanced random forests and EasyEnsemble combine undersampling with bagging. Threshold moving shifts the decision boundary post-training to favor minority recall. Evaluation must rely on precision-recall curves or balanced accuracy rather than overall accuracy, which is misleading under imbalance.

Applications

Imbalanced data methods are indispensable for detecting rare cancer subtypes in cancer biochemistry studies, identifying differentially expressed markers from DNA microarrays and gene expression data, discovering resistance genes in bacterial genetics, and predicting pathogenicity of rare variants in clinical microbiology. These techniques ensure that machine learning models remain sensitive to the minority class, enabling the discovery of truly rare biological signals.