SOTAVerified

Mixture-of-Experts

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 1312 papers

TitleStatusHype
MoE-Mamba: Efficient Selective State Space Models with Mixture of ExpertsCode3
FlashDMoE: Fast Distributed MoE in a Single KernelCode3
BlackMamba: Mixture of Experts for State-Space ModelsCode3
YourMT3+: Multi-instrument Music Transcription with Enhanced Transformer Architectures and Cross-dataset Stem AugmentationCode3
Learning Heterogeneous Mixture of Scene Experts for Large-scale Neural Radiance FieldsCode3
LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge DistillationCode3
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-ScalingCode3
A Survey on Mixture of ExpertsCode3
A Survey on Inference Optimization Techniques for Mixture of Experts ModelsCode3
Reservoir History Matching of the Norne field with generative exotic priors and a coupled Mixture of Experts -- Physics Informed Neural Operator Forward ModelCode3
Scaling Laws for Fine-Grained Mixture of ExpertsCode3
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction TuningCode2
Harder Tasks Need More Experts: Dynamic Routing in MoE ModelsCode2
QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter ModelsCode2
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General TasksCode2
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts LayerCode2
Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark DatasetCode2
No Language Left Behind: Scaling Human-Centered Machine TranslationCode2
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language ModelsCode2
Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language ModelsCode2
Delta Decompression for MoE-based LLMs CompressionCode2
Motion In-Betweening with Phase ManifoldsCode2
DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-IdentificationCode2
Monet: Mixture of Monosemantic Experts for TransformersCode2
Multi-Task Dense Prediction via Mixture of Low-Rank ExpertsCode2
Demystifying the Compression of Mixture-of-Experts Through a Unified FrameworkCode2
MoEUT: Mixture-of-Experts Universal TransformersCode2
MoFE-Time: Mixture of Frequency Domain Experts for Time-Series Forecasting ModelsCode2
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU RoutingCode2
MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery DetectionCode2
ModuleFormer: Modularity Emerges from Mixture-of-ExpertsCode2
MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision TasksCode2
Mixture of Lookup ExpertsCode2
Mixture of A Million ExpertsCode2
Mixture of Tokens: Continuous MoE through Cross-Example AggregationCode2
Fast Feedforward NetworksCode2
CNMBERT: A Model for Converting Hanyu Pinyin Abbreviations to Chinese CharactersCode2
MDFEND: Multi-domain Fake News DetectionCode2
MC-MoE: Mixture Compressor for Mixture-of-Experts LLMs Gains MoreCode2
CLIP-MoE: Towards Building Mixture of Experts for CLIP with Diversified Multiplet UpcyclingCode2
Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization AlignmentCode2
Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-ExpertsCode2
MiniDrive: More Efficient Vision-Language Models with Multi-Level 2D Features as Text Tokens for Autonomous DrivingCode2
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-ExpertsCode2
LiMoE: Mixture of LiDAR Representation Learners from Automotive ScenesCode2
Linear-MoE: Linear Sequence Modeling Meets Mixture-of-ExpertsCode2
LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-TrainingCode2
Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family ExpertsCode2
Learning Robust Stereo Matching in the Wild with Selective Mixture-of-ExpertsCode2
A Closer Look into Mixture-of-Experts in Large Language ModelsCode2
Show:102550
← PrevPage 2 of 27Next →

No leaderboard results yet.