SOTAVerified

Federated Learning

Federated Learning is a machine learning approach that allows multiple devices or entities to collaboratively train a shared model without exchanging their data with each other. Instead of sending data to a central server for training, the model is trained locally on each device, and only the model updates are sent to the central server, where they are aggregated to improve the shared model.

This approach allows for privacy-preserving machine learning, as each device keeps its data locally and only shares the information needed to improve the model.

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SiloBN + ASAMmIoU49.75—Unverified
2SiloBN + SAMmIoU49.1—Unverified
3SiloBNmIoU45.96—Unverified
4FedSAM + SWAmIoU43.42—Unverified
5FedASAM + SWAmIoU43.02—Unverified
6FedAvg + SWAmIoU42.48—Unverified
7FedASAMmIoU42.27—Unverified
8FedSAMmIoU41.22—Unverified
9FedAvgmIoU38.65—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAM + SWAAcc@1-1262Clients68.32—Unverified
2FedSAM + SWAAcc@1-1262Clients68.12—Unverified
3FedAvg + SWAAcc@1-1262Clients67.52—Unverified
4FedASAMAcc@1-1262Clients64.23—Unverified
5FedSAMAcc@1-1262Clients63.72—Unverified
6FedAvgAcc@1-1262Clients61.91—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAM + SWAACC@1-100Clients42.64—Unverified
2FedASAMACC@1-100Clients39.76—Unverified
3FedSAM + SWAACC@1-100Clients39.51—Unverified
4FedSAMACC@1-100Clients36.93—Unverified
5FedAvgACC@1-100Clients36.74—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAM + SWAACC@1-100Clients41.62—Unverified
2FedASAMACC@1-100Clients40.81—Unverified
3FedSAM + SWAACC@1-100Clients39.24—Unverified
4FedAvgACC@1-100Clients38.59—Unverified
5FedSAMACC@1-100Clients38.56—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAM + SWAACC@1-100Clients48.72—Unverified
2FedSAM + SWAACC@1-100Clients46.76—Unverified
3FedASAMACC@1-100Clients46.58—Unverified
4FedSAMACC@1-100Clients44.84—Unverified
5FedAvgACC@1-100Clients41.27—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAM + SWAACC@1-100Clients48.27—Unverified
2FedASAMACC@1-100Clients47.78—Unverified
3FedSAM + SWAACC@1-100Clients46.47—Unverified
4FedSAMACC@1-100Clients46.05—Unverified
5FedAvgACC@1-100Clients42.17—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAM + SWAACC@1-100Clients49.17—Unverified
2FedSAM + SWAACC@1-100Clients47.96—Unverified
3FedASAMACC@1-100Clients45.61—Unverified
4FedSAMACC@1-100Clients44.73—Unverified
5FedAvgACC@1-100Clients40.43—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAM + SWAACC@1-100Clients42.01—Unverified
2FedSAM + SWAACC@1-100Clients39.3—Unverified
3FedASAMACC@1-100Clients36.04—Unverified
4FedSAMACC@1-100Clients31.04—Unverified
5FedAvgACC@1-100Clients30.25—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAMACC@1-100Clients54.97—Unverified
2FedASAM + SWAACC@1-100Clients54.79—Unverified
3FedSAM + SWAACC@1-100Clients53.67—Unverified
4FedSAMACC@1-100Clients53.39—Unverified
5FedAvgACC@1-100Clients50.25—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAMACC@1-100Clients54.5—Unverified
2FedSAM + SWAACC@1-100Clients54.36—Unverified
3FedASAM + SWAACC@1-100Clients54.1—Unverified
4FedSAMACC@1-100Clients53.97—Unverified
5FedAvgACC@1-100Clients50.66—Unverified
#ModelMetricClaimedVerifiedStatus
1FedASAMACC@1-100Clients54.81—Unverified
2FedSAMACC@1-100Clients54.01—Unverified
3FedSAM + SWAACC@1-100Clients53.9—Unverified
4FedASAM + SWAACC@1-100Clients53.86—Unverified
5FedAvgACC@1-100Clients49.92—Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBestAverage Top-1 Accuracy56.2—Unverified