Particle Swarm Optimization for Compact Neural Architecture Search for Image Classification
提出一种基于粒子群优化的进化计算方法，用于自动设计紧凑且灵活的卷积神经网络架构，在多个图像数据集上取得优于现有方法的分类性能，同时降低搜索成本和架构复杂度。
Convolutional neural networks (CNNs) are a superb computing paradigm in deep learning, and their architectures are considered to be the key to performance breakthroughs in various tasks. Recently, neural architecture search (NAS) methods have been proposed to automate the process of network architecture design, many of which have discovered novel CNN architectures that are superior to human-designed ones. However, most of the current NAS methods suffer from either prohibitively high computational complexity of resulting architectures which have inadvertently affected the deep model deployment, or limitations which impede the flexibility of architecture design. To address these deficiencies, this work proposes an evolutionary computation (EC)-based method for compact and flexible NAS. A valuable search space with parameter-efficient mobile-inverted bottleneck convolution blocks as the primitive components is proposed to ensure the initial quality of the compact architectures. In addition, a two-level variable-length particle swarm optimization (PSO) approach is devised to evolve both the microarchitecture and macroarchitecture of CNNs. Furthermore, this study proposes an effective scheme by integrating multiple computationally reduced methods to greatly speed up the evaluation process. Experimental results on the CIFAR-10, CIFAR-100, and ImageNet datasets show the superiority of the proposed method against the state-of-the-art algorithms in terms of the classification performance, search cost, and resulting architecture complexity.