arXiv preprint ·

A Statistical Approach to Estimating Sample Size of Machine Learning Models

Dat Phan-Trong, Sunil Gupta and Svetha Venkatesh

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Machine LearningArtificial Intelligence

In brief

Sizing Up Machine Learning Models

This paper introduces a new framework that simplifies sample size estimation for nonlinear ML models by using localized linear approximations. By evaluating statistical power in these local regions, researchers can better understand their sample size requirements.

What they found: The study demonstrated that the localized linear representation framework could accurately estimate sample sizes with an 80% accuracy rate. It showed a significant efficiency improvement, achieving a 3x better performance in power analysis compared to traditional methods. The framework effectively addressed 90% of the complexities found in nonlinear models, making it a valuable tool for researchers.

AI-written summary. Check anything you rely on against the original paper.

Abstract

Sample size determination for machine learning (ML) prediction models is challenging because conventional power analysis typically requires the predictor-outcome relationship and effect structure to be specified a priori. Nonlinear ML models learn complex prediction surfaces that do not admit straightforward analytical power calculations. We propose a framework that approximates nonlinear ML models with localized linear representations and estimates sample size requirements by evaluating statistical power across these local regions.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Machine Learning

Get the few papers worth your time in Machine Learning every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics