Multi-Model, Hardware-Aware Train-Free Neural Architecture Search

In this blog, we introduce the challenges of traditional NAS solutions and propose a multi-model, hardware-aware, train-free NAS to resolve those challenges. It includes a unified transformer-based search space, a hardware-aware search strategy, and a train-free score method. We also present how this solution improves the multi-domain models’ performance on commodity CPU clusters.