SOTAVerified

Audio Classification

Audio Classification is a machine learning task that involves identifying and tagging audio signals into different classes or categories. The goal of audio classification is to enable machines to automatically recognize and distinguish between different types of audio, such as music, speech, and environmental sounds.

Papers

Showing 301350 of 361 papers

TitleStatusHype
Mirasol3B: A Multimodal Autoregressive model for time-aligned and contextual modalities0
Mixer is more than just a model0
ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation0
Multi-Format Contrastive Learning of Audio Representations0
Multi-label Zero-Shot Audio Classification with Temporal Attention0
Multi-modal Self-Supervision from Generalized Data Transformations0
Multiscale Audio Spectrogram Transformer for Efficient Audio Classification0
Multiscale Multimodal Transformer for Multimodal Action Recognition0
MUPAX: Multidimensional Problem Agnostic eXplainable AI0
Neural Architecture Search for Energy Efficient Always-on Audio Models0
Neuromorphic Wireless Split Computing with Resonate-and-Fire Neurons0
OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning0
OmniVec: Learning robust representations with cross modal sharing0
On fine-tuning of Autoencoders for Fuzzy rule classifiers0
On Negative Sampling for Audio-Visual Contrastive Learning from Movies0
On the choice of the optimal temporal support for audio classification with Pre-trained embeddings0
On the performance of residual block design alternatives in convolutional neural networks for end-to-end audio classification0
Over-Parameterization and Generalization in Audio Classification0
Pex: Memory-efficient Microcontroller Deep Learning through Partial Execution0
PolyViT: Co-training Vision Transformers on Images, Videos and Audio0
Private Speech Classification with Secure Multiparty Computation0
Progressive Rock Music Classification0
Pruning random resistive memory for optimizing analogue AI0
Raw Audio Classification with Cosine Convolutional Neural Network (CosCovNN)0
Raw Waveform-based Audio Classification Using Sample-level CNN Architectures0
Real-time Detection of AI-Generated Speech for DeepFake Voice Conversion0
Representations of Sound in Deep Learning of Audio Features from Music0
"Seeing Sound": Audio Classification with the Wigner-Wille Distribution and Convolutional Neural Networks0
Segment Relevance Estimation for Audio Analysis and Weakly-Labelled Classification0
Self-paced ensemble learning for speech and audio classification0
SemanticAC: Semantics-Assisted Framework for Audio Classification0
Semi Supervised Learning For Few-shot Audio Classification By Episodic Triplet Mining0
Simultaneously Learning Architectures and Features of Deep Neural Networks0
Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead0
Sparse Filtering0
Spectral and Rhythm Features for Audio Classification with Deep Convolutional Neural Networks0
SpectroBank: A filter-bank convolutional layer for CNN-based audio applications0
SpliceOut: A Simple and Efficient Audio Augmentation Method0
STREAM: A Universal State-Space Model for Sparse Geometric Data0
Symbolic Audio Classification via Modal Decision Tree Learning0
Tackling Interpretability in Audio Classification Networks with Non-negative Matrix Factorization0
Task-Specific Audio Coding for Machines: Machine-Learned Latent Features Are Codes for That Machine0
Temporal Knowledge Distillation for On-device Audio Classification0
Temporal-wise Attention Spiking Neural Networks for Event Streams Classification0
The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks0
Towards Robust Few-shot Class Incremental Learning in Audio Classification using Contrastive Representation0
Transformer-based Sequence Labeling for Audio Classification based on MFCCs0
TSPE: Task-Specific Prompt Ensemble for Improved Zero-Shot Audio Classification0
Tuning In: Analysis of Audio Classifier Performance in Clinical Settings with Limited Data0
Unsupervised feature learning for audio classification using convolutional deep belief networks0
Show:102550
← PrevPage 7 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVec2Test mAP0.56Unverified
2OmniVecTest mAP0.55Unverified
3EquiAVTest mAP0.55Unverified
4MAViL (Audio-Visual, single)Test mAP0.53Unverified
5Audiovisual Masked Autoencoder (Audiovisual, Single)Test mAP0.52Unverified
6CAV-MAE (Audio-Visual)Test mAP0.51Unverified
7BEATs (Audio-only, Ensemble)Test mAP0.51Unverified
8UAVM (Audio + Video)Test mAP0.5Unverified
9SSLAM (Audio-Only, Single)Test mAP0.5Unverified
10mn40_as (Ensemble)Test mAP0.5Unverified
#ModelMetricClaimedVerifiedStatus
1OmniVec2Top-1 Accuracy99.1Unverified
2InternVideo2Top-1 Accuracy98.6Unverified
3M2D2 AS+Top-1 Accuracy98.5Unverified
4OmniVecTop-1 Accuracy98.4Unverified
5BEATsTop-1 Accuracy98.1Unverified
6mn40_asTop-1 Accuracy97.45Unverified
7M2D-CLAP/0.7Top-1 Accuracy97.4Unverified
8DyMN-LTop-1 Accuracy97.4Unverified
9M2D-AS/0.7Top-1 Accuracy97.2Unverified
10HTS-ATTop-1 Accuracy97Unverified
#ModelMetricClaimedVerifiedStatus
1ADDICBHI Score65.53Unverified
2BEATs (PAFA)ICBHI Score64.84Unverified
3BTSICBHI Score63.54Unverified
4BEATs (CE)ICBHI Score63.49Unverified
5M2D-X/0.7 (η=0.3)ICBHI Score63.29Unverified
6CycleGuardianICBHI Score63.26Unverified
7M2D/0.7 (e=0.3)ICBHI Score62.73Unverified
8Audio-CLAPICBHI Score62.56Unverified
9AST (Patch-Mix CL)ICBHI Score62.37Unverified
10AFT on Mixed-500ICBHI Score61.79Unverified
#ModelMetricClaimedVerifiedStatus
1MBT (AV)Top 5 Accuracy85.6Unverified
2Mirasol3BTop 1 Accuracy69.8Unverified
3CA2ST(B/16)Top 1 Accuracy68.3Unverified
4ONE-PEACE (Audio-Visual)Top 1 Accuracy68.2Unverified
5CAVA(B/16)Top 1 Accuracy68.2Unverified
6EquiAVTop 1 Accuracy67.1Unverified
7MAViLTop 1 Accuracy67.1Unverified
8MMT (Audio-Visual)Top 1 Accuracy66.2Unverified
9CAV-MAE (Audio-Visual)Top 1 Accuracy65.9Unverified
10UAVM (Audio + Video)Top 1 Accuracy65.8Unverified
#ModelMetricClaimedVerifiedStatus
1Event-SSMPercentage correct95.9Unverified
2SNN with Dilated Convolution with Learnable SpacingsPercentage correct95.1Unverified
3SNN featuring learnable axonal delays with adaptively delay capsPercentage correct92.45Unverified
4CNNPercentage correct92.4Unverified
5SNN with spatio-temporal filters and attentionPercentage correct92.4Unverified
6SNN with temporal-wise attentionPercentage correct91.1Unverified
7SNNPercentage correct87Unverified
8Recurrent convolutional SNNPercentage correct83.5Unverified
9Recurrent SNNPercentage correct83.2Unverified
10Sparse Spiking Gradient DescentPercentage correct77.5Unverified
#ModelMetricClaimedVerifiedStatus
1ONE-PEACEmAP69.7Unverified
2MNmAP65.6Unverified
3PaSST-SmAP65.55Unverified
4DyMN-LmAP65.5Unverified
5PaSST-N-SmAP64.2Unverified
6LHGNNMean AP59Unverified
7PSLAmAP56.71Unverified
8MATPAC (SSL Model)mAP55.2Unverified
9Temporal Knowledge Distillation for On-device Audio ClassificationmAP54.8Unverified
10Large 6-Layer Transformer with PoolingmAP53.7Unverified
#ModelMetricClaimedVerifiedStatus
1EquiAVMean AP42.4Unverified
2SSLAMMean AP40.9Unverified
3EATMean AP40.3Unverified
4BEATsMean AP38.9Unverified
5Base (ours)Mean AP37.4Unverified
6SSAST-PATCHMean AP31Unverified
7SSAST-FRAMEMean AP29.2Unverified
8ConformerMean AP27.6Unverified
#ModelMetricClaimedVerifiedStatus
1PDCAccuracy97.8Unverified
2ASM-RHAccuracy96.51Unverified
3EfficientLEAFAccuracy95.2Unverified
4melspectAccuracy95.1Unverified
5LEAFAccuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1Event-SSMAccuracy88.4Unverified
2SNN with Dilated Convolution with Learnable SpacingsAccuracy80.69Unverified
3RadLIFAccuracy77.4Unverified
4SpikGRUAccuracy77Unverified
5Adaptive SRNNAccuracy74.2Unverified
#ModelMetricClaimedVerifiedStatus
1EfficientLEAF (8s)Accuracy72.2Unverified
2EfficientLEAFAccuracy42.9Unverified
3LEAFAccuracy42.3Unverified
4melspectAccuracy39.9Unverified
#ModelMetricClaimedVerifiedStatus
1CrissCross (AudioSet)Top-1 Accuracy97Unverified
2CrissCross (Kinetics-400)Top-1 Accuracy96Unverified
3XDCTop-1 Accuracy95Unverified
4CrissCross (Kinetics-Sound)Top-1 Accuracy93Unverified
#ModelMetricClaimedVerifiedStatus
1Audiovisual Masked Autoencoder (Audiovisual, Single)Top-1 Action46Unverified
2Audiovisual Masked Autoencoder (Video-only, Single)Top-1 Action45.8Unverified
3Audiovisual Masked Autoencoder (Audio-only, Single)Top-1 Action19.7Unverified
4PlayItBackX3Top-1 Action15.9Unverified
#ModelMetricClaimedVerifiedStatus
1M2D-AS/0.7Mean AP48.5Unverified
2LHGNNMean AP46.6Unverified
3VAB-Encodec (Ours)Mean AP38.7Unverified
#ModelMetricClaimedVerifiedStatus
1EfficientLEAFAccuracy60.2Unverified
2melspectAccuracy58.8Unverified
3LEAFAccuracy50.2Unverified
#ModelMetricClaimedVerifiedStatus
1AUCO ResNetAUC0.82Unverified
2DenseNet 201AUC0.6Unverified
3Inception ResNet V2AUC0.6Unverified
#ModelMetricClaimedVerifiedStatus
1Mirasol3BAccuracy78.2Unverified
2CA2ST(B/16)Accuracy61Unverified
3CAVA(B/16)Accuracy60.3Unverified
#ModelMetricClaimedVerifiedStatus
1ASM-RH-ATop-1 Accuracy75.4Unverified
2ERANN-0-4Top-1 Accuracy74.8Unverified
#ModelMetricClaimedVerifiedStatus
1Qwen-AudioAccuracy 92.89Unverified
2VocalSound BaselineAccuracy 90.5Unverified
#ModelMetricClaimedVerifiedStatus
1XGBoost (330)Accuracy (10-fold)99.3Unverified
#ModelMetricClaimedVerifiedStatus
1animal2vecAP0.91Unverified
#ModelMetricClaimedVerifiedStatus
1AudioAccuracy (%)64.5Unverified
#ModelMetricClaimedVerifiedStatus
1CDILFruitFlies97.09Unverified