arXiv preprint ·
Just add noise: Debiasing tree-based variable importance in mixed data
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Variable importance scores from tree-based methods such as random forests favor continuous predictors over categorical ones. We present a theoretical analysis of this bias and propose a simple remedy: add a small amount of noise to each categorical predictor. The correction is demonstrated on a variety of simulated and real-world datasets and combined with integrated path stability selection to perform variable selection with false discovery control for mixed data.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning (Statistics)
Online Bayesian Node Classification on Inductive Graphs under Distribution Shift
Multi-source conformal prediction: leveraging heterogeneity via localization
A Functional SVD Framework for Regularized Multivariate Functional PCA with Dual Penalization
On Large-Scale Multiple Testing Over Networks: A Non-Asymptotic Approach
Closed-form Bayesian homography estimation from noisy point correspondences
Get the few papers worth your time in Machine Learning (Statistics) every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.