MultiTab is a benchmark suite and evaluation framework designed for multi-dimensional analysis of tabular learning algorithms.
It categorizes 196 datasets based on key data characteristics and evaluates 13 models to understand how model behavior varies across diverse data regimes.
Model performance is shown to be highly sensitive to data regimes, with different models excelling based on factors like sample size and feature interaction.
MultiTab enables more informed model design and provides practical guidance for selecting models suited to specific data characteristics.