SOTAVerified

Audio Classification

Audio Classification is a machine learning task that involves identifying and tagging audio signals into different classes or categories. The goal of audio classification is to enable machines to automatically recognize and distinguish between different types of audio, such as music, speech, and environmental sounds.

Papers

Showing 51100 of 361 papers

TitleStatusHype
Adaptive Differential Denoising for Respiratory Sounds ClassificationCode1
Audio classification with Dilated Convolution with Learnable SpacingsCode1
Efficient Training of Audio Transformers with PatchoutCode1
EfficientLEAF: A Faster LEarnable Audio Frontend of Questionable UseCode1
Investigating Design Choices in Joint-Embedding Predictive Architectures for General Audio Representation LearningCode1
LEAF: A Learnable Frontend for Audio ClassificationCode1
On the Transferability of Large-Scale Self-Supervision to Few-Shot Audio ClassificationCode1
Perceiver: General Perception with Iterative AttentionCode1
animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacousticsCode1
Audio Tagging on an Embedded Hardware PlatformCode1
Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable SpacingsCode1
Learning music audio representations via weak language supervisionCode1
RespireNet: A Deep Neural Network for Accurately Detecting Abnormal Lung Sounds in Limited Data SettingCode1
DTF-AT: Decoupled Time-Frequency Audio Transformer for Event ClassificationCode1
On Compositions of Transformations in Contrastive Self-Supervised LearningCode1
MetaAudio: A Few-Shot Audio Classification BenchmarkCode1
DASS: Distilled Audio State Space Models Are Stronger and More Duration-Scalable LearnersCode1
MAX-AST: COMBINING CONVOLUTION, LOCAL AND GLOBAL SELF-ATTENTIONS FOR AUDIO EVENT CLASSIFICATIONCode1
Π-nets: Deep Polynomial Neural NetworksCode1
MAE-AST: Masked Autoencoding Audio Spectrogram TransformerCode1
CRNNs for Urban Sound Tagging with spatiotemporal contextCode1
Device-Robust Acoustic Scene Classification via Impulse Response AugmentationCode1
A Spatio-temporal Deep Learning Approach for Underwater Acoustic Signals ClassificationCode1
DCASE 2021 Task 3: Spectrotemporally-aligned Features for Polyphonic Sound Event Localization and DetectionCode1
Masked Autoencoders that ListenCode1
BEATs: Audio Pre-Training with Acoustic TokenizersCode1
Artificially Synthesising Data for Audio Classification and Segmentation to Improve Speech and Music Detection in Radio BroadcastCode1
Masked Latent Prediction and Classification for Self-Supervised Audio Representation LearningCode1
Adversarial Fine-tuning using Generated Respiratory Sound to Address Class ImbalanceCode1
CycleGuardian: A Framework for Automatic RespiratorySound classification Based on Improved Deep clustering and Contrastive LearningCode1
Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge TransferCode1
Broaden Your Views for Self-Supervised Video LearningCode1
BTS: Bridging Text and Sound Modalities for Metadata-Aided Respiratory Sound ClassificationCode1
Acoustic Prompt Tuning: Empowering Large Language Models with Audition CapabilitiesCode1
A surrogate gradient spiking baseline for speech command recognitionCode1
ElasticAST: An Audio Spectrogram Transformer for All Length and ResolutionsCode1
Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP BlockCode1
Audio-Visual Instance Discrimination with Cross-Modal AgreementCode1
CLARA: Multilingual Contrastive Learning for Audio Representation AcquisitionCode1
ATST: Audio Representation Learning with Teacher-Student TransformerCode1
Classification of Long Sequential Data using Circular Dilated Convolutional Neural NetworksCode1
EquiAV: Leveraging Equivariance for Audio-Visual Contrastive LearningCode1
Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal ModelsCode1
CNN Architectures for Large-Scale Audio ClassificationCode1
AUCO ResNet: an end-to-end network for Covid-19 pre-screening from cough and breathCode1
Federated Self-Training for Semi-Supervised Audio RecognitionCode1
Continual Transformers: Redundancy-Free Attention for Online InferenceCode1
AudioMNIST: Exploring Explainable Artificial Intelligence for Audio Analysis on a Simple BenchmarkCode1
Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level TasksCode1
MAST: Multiscale Audio Spectrogram TransformersCode1
Show:102550
← PrevPage 2 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1OmniVec2Test mAP0.56Unverified
2OmniVecTest mAP0.55Unverified
3EquiAVTest mAP0.55Unverified
4MAViL (Audio-Visual, single)Test mAP0.53Unverified
5Audiovisual Masked Autoencoder (Audiovisual, Single)Test mAP0.52Unverified
6CAV-MAE (Audio-Visual)Test mAP0.51Unverified
7BEATs (Audio-only, Ensemble)Test mAP0.51Unverified
8UAVM (Audio + Video)Test mAP0.5Unverified
9SSLAM (Audio-Only, Single)Test mAP0.5Unverified
10mn40_as (Ensemble)Test mAP0.5Unverified
#ModelMetricClaimedVerifiedStatus
1OmniVec2Top-1 Accuracy99.1Unverified
2InternVideo2Top-1 Accuracy98.6Unverified
3M2D2 AS+Top-1 Accuracy98.5Unverified
4OmniVecTop-1 Accuracy98.4Unverified
5BEATsTop-1 Accuracy98.1Unverified
6mn40_asTop-1 Accuracy97.45Unverified
7DyMN-LTop-1 Accuracy97.4Unverified
8M2D-CLAP/0.7Top-1 Accuracy97.4Unverified
9M2D-AS/0.7Top-1 Accuracy97.2Unverified
10HTS-ATTop-1 Accuracy97Unverified
#ModelMetricClaimedVerifiedStatus
1ADDICBHI Score65.53Unverified
2BEATs (PAFA)ICBHI Score64.84Unverified
3BTSICBHI Score63.54Unverified
4BEATs (CE)ICBHI Score63.49Unverified
5M2D-X/0.7 (η=0.3)ICBHI Score63.29Unverified
6CycleGuardianICBHI Score63.26Unverified
7M2D/0.7 (e=0.3)ICBHI Score62.73Unverified
8Audio-CLAPICBHI Score62.56Unverified
9AST (Patch-Mix CL)ICBHI Score62.37Unverified
10AFT on Mixed-500ICBHI Score61.79Unverified
#ModelMetricClaimedVerifiedStatus
1MBT (AV)Top 5 Accuracy85.6Unverified
2Mirasol3BTop 1 Accuracy69.8Unverified
3CA2ST(B/16)Top 1 Accuracy68.3Unverified
4ONE-PEACE (Audio-Visual)Top 1 Accuracy68.2Unverified
5CAVA(B/16)Top 1 Accuracy68.2Unverified
6EquiAVTop 1 Accuracy67.1Unverified
7MAViLTop 1 Accuracy67.1Unverified
8MMT (Audio-Visual)Top 1 Accuracy66.2Unverified
9CAV-MAE (Audio-Visual)Top 1 Accuracy65.9Unverified
10UAVM (Audio + Video)Top 1 Accuracy65.8Unverified
#ModelMetricClaimedVerifiedStatus
1Event-SSMPercentage correct95.9Unverified
2SNN with Dilated Convolution with Learnable SpacingsPercentage correct95.1Unverified
3SNN featuring learnable axonal delays with adaptively delay capsPercentage correct92.45Unverified
4SNN with spatio-temporal filters and attentionPercentage correct92.4Unverified
5CNNPercentage correct92.4Unverified
6SNN with temporal-wise attentionPercentage correct91.1Unverified
7SNNPercentage correct87Unverified
8Recurrent convolutional SNNPercentage correct83.5Unverified
9Recurrent SNNPercentage correct83.2Unverified
10Sparse Spiking Gradient DescentPercentage correct77.5Unverified
#ModelMetricClaimedVerifiedStatus
1ONE-PEACEmAP69.7Unverified
2MNmAP65.6Unverified
3PaSST-SmAP65.55Unverified
4DyMN-LmAP65.5Unverified
5PaSST-N-SmAP64.2Unverified
6LHGNNMean AP59Unverified
7PSLAmAP56.71Unverified
8MATPAC (SSL Model)mAP55.2Unverified
9Temporal Knowledge Distillation for On-device Audio ClassificationmAP54.8Unverified
10Large 6-Layer Transformer with PoolingmAP53.7Unverified
#ModelMetricClaimedVerifiedStatus
1EquiAVMean AP42.4Unverified
2SSLAMMean AP40.9Unverified
3EATMean AP40.3Unverified
4BEATsMean AP38.9Unverified
5Base (ours)Mean AP37.4Unverified
6SSAST-PATCHMean AP31Unverified
7SSAST-FRAMEMean AP29.2Unverified
8ConformerMean AP27.6Unverified
#ModelMetricClaimedVerifiedStatus
1PDCAccuracy97.8Unverified
2ASM-RHAccuracy96.51Unverified
3EfficientLEAFAccuracy95.2Unverified
4LEAFAccuracy95.1Unverified
5melspectAccuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1Event-SSMAccuracy88.4Unverified
2SNN with Dilated Convolution with Learnable SpacingsAccuracy80.69Unverified
3RadLIFAccuracy77.4Unverified
4SpikGRUAccuracy77Unverified
5Adaptive SRNNAccuracy74.2Unverified
#ModelMetricClaimedVerifiedStatus
1EfficientLEAF (8s)Accuracy72.2Unverified
2EfficientLEAFAccuracy42.9Unverified
3LEAFAccuracy42.3Unverified
4melspectAccuracy39.9Unverified
#ModelMetricClaimedVerifiedStatus
1CrissCross (AudioSet)Top-1 Accuracy97Unverified
2CrissCross (Kinetics-400)Top-1 Accuracy96Unverified
3XDCTop-1 Accuracy95Unverified
4CrissCross (Kinetics-Sound)Top-1 Accuracy93Unverified
#ModelMetricClaimedVerifiedStatus
1Audiovisual Masked Autoencoder (Audiovisual, Single)Top-1 Action46Unverified
2Audiovisual Masked Autoencoder (Video-only, Single)Top-1 Action45.8Unverified
3Audiovisual Masked Autoencoder (Audio-only, Single)Top-1 Action19.7Unverified
4PlayItBackX3Top-1 Action15.9Unverified
#ModelMetricClaimedVerifiedStatus
1M2D-AS/0.7Mean AP48.5Unverified
2LHGNNMean AP46.6Unverified
3VAB-Encodec (Ours)Mean AP38.7Unverified
#ModelMetricClaimedVerifiedStatus
1EfficientLEAFAccuracy60.2Unverified
2melspectAccuracy58.8Unverified
3LEAFAccuracy50.2Unverified
#ModelMetricClaimedVerifiedStatus
1AUCO ResNetAUC0.82Unverified
2DenseNet 201AUC0.6Unverified
3Inception ResNet V2AUC0.6Unverified
#ModelMetricClaimedVerifiedStatus
1Mirasol3BAccuracy78.2Unverified
2CA2ST(B/16)Accuracy61Unverified
3CAVA(B/16)Accuracy60.3Unverified
#ModelMetricClaimedVerifiedStatus
1ASM-RH-ATop-1 Accuracy75.4Unverified
2ERANN-0-4Top-1 Accuracy74.8Unverified
#ModelMetricClaimedVerifiedStatus
1Qwen-AudioAccuracy 92.89Unverified
2VocalSound BaselineAccuracy 90.5Unverified
#ModelMetricClaimedVerifiedStatus
1XGBoost (330)Accuracy (10-fold)99.3Unverified
#ModelMetricClaimedVerifiedStatus
1animal2vecAP0.91Unverified
#ModelMetricClaimedVerifiedStatus
1AudioAccuracy (%)64.5Unverified
#ModelMetricClaimedVerifiedStatus
1CDILFruitFlies97.09Unverified