Neural Architecture Search

Neural architecture search (NAS) is a technique for automating the design of artificial neural networks (ANN), a widely used model in the field of machine learning. NAS essentially takes the process of a human manually tweaking a neural network and learning what works well, and automates this task to discover more complex architectures.

Image Credit : NAS with Reinforcement Learning

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1576–1600 of 1915 papers

Title	Date	Tasks	Status
Optimizing Neural Architecture Search using Limited GPU Time in a Dynamic Search Space: A Gene Expression Programming Approach	May 15, 2020	GPUNeural Architecture Search	CodeCode Available
Λ-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells	Oct 14, 2022	Neural Architecture Search	CodeCode Available
Learnable Embedding Space for Efficient Neural Architecture Compression	Feb 1, 2019	Bayesian OptimizationNeural Architecture Search	CodeCode Available
Learnable Extended Activation Function (LEAF) for Deep Neural Networks	Sep 30, 2023	Activation Function Synthesisimage-classification	CodeCode Available
Learn Basic Skills and Reuse: Modularized Adaptive Neural Architecture Search (MANAS)	Aug 23, 2022	Neural Architecture Search	CodeCode Available
Optimizing the Neural Architecture of Reinforcement Learning Agents	Nov 30, 2020	Atari GamesMeta Reinforcement Learning	CodeCode Available
Automatic Generation of Neural Architecture Search Spaces	Nov 21, 2021	Neural Architecture Search	CodeCode Available
Language Models with Transformers	Apr 20, 2019	Computational EfficiencyLanguage Modeling	CodeCode Available
Order-Preserving GFlowNets	Sep 30, 2023	Neural Architecture Search	CodeCode Available
Automated Heterogeneous Network learning with Non-Recursive Message Passing	Jan 10, 2025	Graph Neural NetworkNeural Architecture Search	CodeCode Available
OStr-DARTS: Differentiable Neural Architecture Search based on Operation Strength	Sep 22, 2024	AttributeNeural Architecture Search	CodeCode Available
Colab NAS: Obtaining lightweight task-specific convolutional neural networks following Occam's razor	Dec 15, 2022	GPUHardware Aware Neural Architecture Search	CodeCode Available
Learning Deep Morphological Networks with Neural Architecture Search	Jun 14, 2021	Edge DetectionMeta-Learning	CodeCode Available
3DLaneNAS: Neural Architecture Search for Accurate and Light-Weight 3D Lane Detection	Sep 6, 2022	3D Lane DetectionAutonomous Driving	CodeCode Available
Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data	Dec 17, 2019	Neural Architecture SearchReinforcement Learning	CodeCode Available
Generalized Latency Performance Estimation for Once-For-All Neural Architecture Search	Jan 4, 2021	AllGPU	CodeCode Available
CHASE: Robust Visual Tracking via Cell-Level Differentiable Neural Architecture Search	Jul 2, 2021	Neural Architecture SearchSemantic Segmentation	CodeCode Available
Learning from Mistakes -- A Framework for Neural Architecture Search	Nov 11, 2021	BIG-bench Machine LearningNeural Architecture Search	CodeCode Available
Channel-wise Mixed-precision Assignment for DNN Inference on Constrained Edge Nodes	Jun 17, 2022	Neural Architecture SearchQuantization	CodeCode Available
Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searching	Nov 11, 2019	Action RecognitionNeural Architecture Search	CodeCode Available
On Adversarial Robustness: A Neural Architecture Search perspective	Jul 16, 2020	Adversarial RobustnessNeural Architecture Search	CodeCode Available
Learning Implicitly Recurrent CNNs Through Parameter Sharing	Feb 26, 2019	image-classificationImage Classification	CodeCode Available
Learning Interpretable Models Through Multi-Objective Neural Architecture Search	Dec 16, 2021	Explainable Artificial Intelligence (XAI)image-classification	CodeCode Available
Parallel Hyperparameter Optimization Of Spiking Neural Network	Mar 1, 2024	Bayesian OptimizationGPU	CodeCode Available
Unifying and Boosting Gradient-Based Training-Free Neural Architecture Search	Jan 24, 2022	Neural Architecture Search	CodeCode Available

Show:10 25 50

← PrevPage 64 of 77Next →

All datasets ImageNet NAS-Bench-201, ImageNet-16-120 CIFAR-10 NAS-Bench-201, CIFAR-100 NAS-Bench-201, CIFAR-10 CIFAR-10 Image Classification CIFAR-100 NATS-Bench Topology, CIFAR-10 NATS-Bench Topology, CIFAR-100 NATS-Bench Topology, ImageNet16-120 Food-101 NAS-Bench-101

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SPOS (ProxylessNAS (GPU) latency)	Accuracy	75.3	—	Unverified
2	SPOS (FBNet-C latency)	Accuracy	75.1	—	Unverified
3	SPOS (block search + channel search)	Accuracy	74.7	—	Unverified
4	MUXNet-xs	Top-1 Error Rate	33.3	—	Unverified
5	FBNetV2-F1	Top-1 Error Rate	31.7	—	Unverified
6	LayerNAS-60M	Top-1 Error Rate	31	—	Unverified
7	NASGEP	Top-1 Error Rate	29.51	—	Unverified
8	MUXNet-s	Top-1 Error Rate	28.4	—	Unverified
9	NN-MASS-A	Top-1 Error Rate	27.1	—	Unverified
10	FBNetV2-F3	Top-1 Error Rate	26.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CR-LSO	Accuracy (Test)	46.98	—	Unverified
2	Shapley-NAS	Accuracy (Test)	46.85	—	Unverified
3	β-RDARTS-L2	Accuracy (Test)	46.71	—	Unverified
4	β-SDARTS-RS	Accuracy (Test)	46.71	—	Unverified
5	ASE-NAS+	Accuracy (Val)	46.66	—	Unverified
6	NAR	Accuracy (Test)	46.66	—	Unverified
7	BaLeNAS-TF	Accuracy (Test)	46.54	—	Unverified
8	AG-Net	Accuracy (Test)	46.42	—	Unverified
9	Local search	Accuracy (Test)	46.38	—	Unverified
10	NASBOT	Accuracy (Test)	46.37	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Balanced Mixture	Accuracy (% )	91.55	—	Unverified
2	GDAS	Top-1 Error Rate	3.4	—	Unverified
3	Bonsai-Net	Top-1 Error Rate	3.35	—	Unverified
4	Net2 (2)	Top-1 Error Rate	3.3	—	Unverified
5	μDARTS	Top-1 Error Rate	3.28	—	Unverified
6	NN-MASS- CIFAR-C	Top-1 Error Rate	3.18	—	Unverified
7	NN-MASS- CIFAR-A	Top-1 Error Rate	3	—	Unverified
8	DARTS (first order)	Top-1 Error Rate	3	—	Unverified
9	NASGEP	Top-1 Error Rate	2.82	—	Unverified
10	AlphaX-1 (cutout NASNet)	Top-1 Error Rate	2.82	—	Unverified