Neural Architecture Search

Neural architecture search (NAS) is a technique for automating the design of artificial neural networks (ANN), a widely used model in the field of machine learning. NAS essentially takes the process of a human manually tweaking a neural network and learning what works well, and automates this task to discover more complex architectures.

Image Credit : NAS with Reinforcement Learning

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 176–200 of 1915 papers

Title	Date	Tasks	Status	Hype	Score
Aligned Structured Sparsity Learning for Efficient Image Super-Resolution	Dec 1, 2021	Image Super-ResolutionKnowledge Distillation	CodeCode Available	1	5
Accelerating Evolutionary Neural Architecture Search via Multi-Fidelity Evaluation	Aug 10, 2021	GPUNeural Architecture Search	CodeCode Available	1	5
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models	Mar 24, 2020	Neural Architecture Search	CodeCode Available	1	5
Automated Graph Machine Learning: Approaches, Libraries, Benchmarks and Directions	Jan 4, 2022	BIG-bench Machine LearningGraph Learning	CodeCode Available	1	5
BiX-NAS: Searching Efficient Bi-directional Architecture for Medical Image Segmentation	Jun 26, 2021	Image SegmentationMedical Image Segmentation	CodeCode Available	1	5
AlphaNet: Improved Training of Supernets with Alpha-Divergence	Feb 16, 2021	Image ClassificationNeural Architecture Search	CodeCode Available	1	5
Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation	Jun 1, 2020	Knowledge DistillationNeural Architecture Search	CodeCode Available	1	5
AutoML: A Survey of the State-of-the-Art	Aug 2, 2019	AutoMLFeature Engineering	CodeCode Available	1	5
BN-NAS: Neural Architecture Search with Batch Normalization	Aug 16, 2021	Neural Architecture Search	CodeCode Available	1	5
FlowNAS: Neural Architecture Search for Optical Flow Estimation	Jul 4, 2022	image-classificationImage Classification	CodeCode Available	1	5
FNA++: Fast Network Adaptation via Parameter Remapping and Architecture Search	Jun 21, 2020	image-classificationImage Classification	CodeCode Available	1	5
Deep Multimodal Neural Architecture Search	Apr 25, 2020	DecoderImage-text matching	CodeCode Available	1	5
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search	Mar 23, 2021	Image ClassificationNeural Architecture Search	CodeCode Available	1	5
Designing the Topology of Graph Neural Networks: A Novel Feature Fusion Perspective	Dec 29, 2021	feature selectionNeural Architecture Search	CodeCode Available	1	5
Automated Concatenation of Embeddings for Structured Prediction	Oct 10, 2020	Aspect ExtractionChunking	CodeCode Available	1	5
AdvRush: Searching for Adversarially Robust Neural Architectures	Aug 3, 2021	Adversarial RobustnessNeural Architecture Search	CodeCode Available	1	5
BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization	Feb 20, 2021	Neural Architecture SearchQuantization	CodeCode Available	1	5
Dataset Condensation with Distribution Matching	Oct 8, 2021	Continual LearningDataset Condensation	CodeCode Available	1	5
Generic Neural Architecture Search via Regression	Aug 4, 2021	image-classificationImage Classification	CodeCode Available	1	5
Grafting Transformer on Automatically Designed Convolutional Neural Network for Hyperspectral Image Classification	Oct 21, 2021	ClassificationHyperspectral Image Classification	CodeCode Available	1	5
Can GPT-4 Perform Neural Architecture Search?	Apr 21, 2023	NavigateNeural Architecture Search	CodeCode Available	1	5
CAKES: Channel-wise Automatic KErnel Shrinking for Efficient 3D Networks	Mar 28, 2020	3D Medical Imaging SegmentationAction Recognition	CodeCode Available	1	5
AutoGL: A Library for Automated Graph Learning	Apr 11, 2021	AutoMLBIG-bench Machine Learning	CodeCode Available	1	5
AOWS: Adaptive and optimal network width search with latency constraints	May 21, 2020	Neural Architecture Search	CodeCode Available	1	5
DATA: Domain-Aware and Task-Aware Self-supervised Learning	Mar 17, 2022	image-classificationImage Classification	CodeCode Available	1	5

Show:10 25 50

← PrevPage 8 of 77Next →

All datasets ImageNet NAS-Bench-201, ImageNet-16-120 CIFAR-10 NAS-Bench-201, CIFAR-100 NAS-Bench-201, CIFAR-10 CIFAR-10 Image Classification CIFAR-100 NATS-Bench Topology, CIFAR-10 NATS-Bench Topology, CIFAR-100 NATS-Bench Topology, ImageNet16-120 Food-101 NAS-Bench-101

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SPOS (ProxylessNAS (GPU) latency)	Accuracy	75.3	—	Unverified
2	SPOS (FBNet-C latency)	Accuracy	75.1	—	Unverified
3	SPOS (block search + channel search)	Accuracy	74.7	—	Unverified
4	MUXNet-xs	Top-1 Error Rate	33.3	—	Unverified
5	FBNetV2-F1	Top-1 Error Rate	31.7	—	Unverified
6	LayerNAS-60M	Top-1 Error Rate	31	—	Unverified
7	NASGEP	Top-1 Error Rate	29.51	—	Unverified
8	MUXNet-s	Top-1 Error Rate	28.4	—	Unverified
9	NN-MASS-A	Top-1 Error Rate	27.1	—	Unverified
10	FBNetV2-F3	Top-1 Error Rate	26.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CR-LSO	Accuracy (Test)	46.98	—	Unverified
2	Shapley-NAS	Accuracy (Test)	46.85	—	Unverified
3	β-RDARTS-L2	Accuracy (Test)	46.71	—	Unverified
4	β-SDARTS-RS	Accuracy (Test)	46.71	—	Unverified
5	ASE-NAS+	Accuracy (Val)	46.66	—	Unverified
6	NAR	Accuracy (Test)	46.66	—	Unverified
7	BaLeNAS-TF	Accuracy (Test)	46.54	—	Unverified
8	AG-Net	Accuracy (Test)	46.42	—	Unverified
9	Local search	Accuracy (Test)	46.38	—	Unverified
10	NASBOT	Accuracy (Test)	46.37	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Balanced Mixture	Accuracy (% )	91.55	—	Unverified
2	GDAS	Top-1 Error Rate	3.4	—	Unverified
3	Bonsai-Net	Top-1 Error Rate	3.35	—	Unverified
4	Net2 (2)	Top-1 Error Rate	3.3	—	Unverified
5	μDARTS	Top-1 Error Rate	3.28	—	Unverified
6	NN-MASS- CIFAR-C	Top-1 Error Rate	3.18	—	Unverified
7	NN-MASS- CIFAR-A	Top-1 Error Rate	3	—	Unverified
8	DARTS (first order)	Top-1 Error Rate	3	—	Unverified
9	NASGEP	Top-1 Error Rate	2.82	—	Unverified
10	AlphaX-1 (cutout NASNet)	Top-1 Error Rate	2.82	—	Unverified