A method that automatically searches for a good neural network structure.
NAS is a bake-off for neural nets. The recipe with the best cake stays.
It designs model structure by testing many options. This saves hand tuning, but the training bill can get scary.
Neural-network
NAS searches the structure of a neural network.
HPO
NAS can be seen as HPO with a bigger search space.
RL
Early NAS often used RL to suggest candidate structures.
Bayesian Optimization
Bayesian Optimization helps NAS avoid costly trial and error.