Large Reasoning Models (LRMs) show impressive performance in complex tasks by using extended Chain-of-Thought reasoning.
Test-time scaling methods like prolonging CoT can enhance LRMs' accuracy but lead to decoding overhead due to redundant thinking CoTs.
TrimR is proposed as a verifier-based, training-free framework for dynamic CoT compression to improve reasoning and scaling efficiency without fine-tuning LRMs or verifiers.
Empirical evaluations demonstrate TrimR's effectiveness in enhancing inference efficiency on various benchmarks without compromising accuracy, especially for large-batch workloads.