Researchers from Purdue University, AWS AI Labs, and the University of Virginia have proposed LEDEX (learning to self-debug and explain code), a novel training framework designed to enhance LLMs’ self-debugging capabilities.
LEDEX employs a comprehensive architecture containing data collection, verification, and multi-stage training processes.
The framework shows significant improvements in pass rates across benchmark datasets, achieving up to 15.92% increase in pass@1 and 9.30% in pass@10 metrics.
LEDEX's model-agnostic nature is evidenced by its successful implementation with GPT-3.5-Turbo and CodeLlama, while its rigorous data verification process ensures the quality of code explanations and refinements.