Feature engineering is crucial for enhancing AI model performance by transforming raw data into discriminative features.
A new concept called agentic feature augmentation is introduced to unify feature selection and generation through a Multi-Agent System with Long and Short-Term Memory (MAGS).
MAGS includes a selector agent to eliminate redundant features, a generator agent to create informative new dimensions, and a router agent for coordination.
The framework utilizes in-context learning, short-term memory for immediate feedback, long-term memory for global guidance, and a reinforcement fine-tuning technique for effective decision-making in navigating feature space.