SOTAVerified

Mixture-of-Experts

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 1312 papers

TitleStatusHype
Higher Layers Need More LoRA ExpertsCode2
TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of ExpertsCode2
Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language ModelsCode2
Multi-Task Dense Prediction via Mixture of Low-Rank ExpertsCode2
Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family ExpertsCode2
KAN4TSF: Are KAN and KAN-based models Effective for Time Series Forecasting?Code2
Monet: Mixture of Monosemantic Experts for TransformersCode2
Motion In-Betweening with Phase ManifoldsCode2
No Language Left Behind: Scaling Human-Centered Machine TranslationCode2
MoFE-Time: Mixture of Frequency Domain Experts for Time-Series Forecasting ModelsCode2
Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer ModelsCode2
MoEUT: Mixture-of-Experts Universal TransformersCode2
MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery DetectionCode2
ModuleFormer: Modularity Emerges from Mixture-of-ExpertsCode2
A Closer Look into Mixture-of-Experts in Large Language ModelsCode2
LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-TrainingCode2
Linear-MoE: Linear Sequence Modeling Meets Mixture-of-ExpertsCode2
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language ModelsCode2
Mixture of Lookup ExpertsCode2
Mixture of A Million ExpertsCode2
Mixture of Tokens: Continuous MoE through Cross-Example AggregationCode2
Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time AdaptationCode2
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-ExpertsCode2
Aurora:Activating Chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-TuningCode2
MDFEND: Multi-domain Fake News DetectionCode2
MiniDrive: More Efficient Vision-Language Models with Multi-Level 2D Features as Text Tokens for Autonomous DrivingCode2
CNMBERT: A Model for Converting Hanyu Pinyin Abbreviations to Chinese CharactersCode2
CLIP-MoE: Towards Building Mixture of Experts for CLIP with Diversified Multiplet UpcyclingCode2
MC-MoE: Mixture Compressor for Mixture-of-Experts LLMs Gains MoreCode2
Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark DatasetCode2
Superposition in Transformers: A Novel Way of Building Mixture of ExpertsCode2
M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image AnalysisCode1
M^3ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-designCode1
M^4oE: A Foundation Model for Medical Multimodal Image Segmentation with Mixture of ExpertsCode1
M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation FrameworkCode1
LMHaze: Intensity-aware Image Dehazing with a Large-scale Multi-intensity Real Haze DatasetCode1
M3-Jepa: Multimodal Alignment via Multi-directional MoE based on the JEPA frameworkCode1
LOLA -- An Open-Source Massively Multilingual Large Language ModelCode1
LLMBind: A Unified Modality-Task Integration FrameworkCode1
PAD-Net: An Efficient Framework for Dynamic NetworksCode1
LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language ModelsCode1
Long-Tailed Visual Recognition via Self-Heterogeneous Integration with Knowledge ExcavationCode1
Making Neural Networks Interpretable with Attribution: Application to Implicit Signals PredictionCode1
LITE: Modeling Environmental Ecosystems with Multimodal Large Language ModelsCode1
AlphaLoRA: Assigning LoRA Experts Based on Layer Training QualityCode1
A Time Series is Worth Five Experts: Heterogeneous Mixture of Experts for Traffic Flow PredictionCode1
Learning to Skip the Middle Layers of TransformersCode1
LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language ModelsCode1
ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action ModelCode1
Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-ExpertsCode1
Show:102550
← PrevPage 3 of 27Next →

No leaderboard results yet.