This article reviews four major gradient descent-based architecture search methods for discovering the best neural architecture for image classification: DARTS, PDARTS, Fair DARTS, and Att-DARTS.
DARTS is a popular method that treats the architecture as a continuous variable and optimizes it using gradient-based methods. It uses a cell-based search space with operations such as convolutions, pooling, and identity.
DARTS learns the cell architecture by searching for the optimal combination of operations. It uses eight cells, including normal and reduction cells, to design high-performance neural networks.
The goal of DARTS is to learn the operation strength probabilities (α) and the optimal weights (ω) for constructing a cell and designing neural networks.