SOTAVerified

Vulnerability Detection

Vulnerability detection plays a crucial role in safeguarding against these threats by identifying weaknesses and potential entry points that malicious actors could exploit. Through advanced scanning techniques and penetration testing, vulnerability detection tools meticulously analyze web applications and websites for vulnerabilities such as SQL injection, cross-site scripting (XSS), and insecure authentication mechanisms.

By proactively identifying and addressing vulnerabilities, organizations can strengthen their online security posture and mitigate the risk of data breaches, financial loss, and reputational damage. Additionally, vulnerability detection empowers businesses to stay compliant with industry regulations and standards, demonstrating their commitment to safeguarding sensitive information and maintaining the trust of their customers. With the evolving threat landscape and increasingly sophisticated attack vectors, investing in robust vulnerability detection measures is paramount for staying one step ahead of cyber threats and ensuring the resilience of web-based platforms and services.

Papers

Showing 1–25 of 216 papers

TitleStatusHype
CORE: Benchmarking LLMs Code Reasoning Capabilities through Static Analysis Tasks—0
SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models—0
Smart-LLaMA-DPO: Reinforced Large Language Model for Explainable Smart Contract Vulnerability Detection—0
Identifying Helpful Context for LLM-based Vulnerability Repair: A Preliminary Study—0
Today's Cat Is Tomorrow's Dog: Accounting for Time-Based Changes in the Labels of ML Vulnerability Detection Approaches—0
Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning DataCode0
Ai-Driven Vulnerability Analysis in Smart Contracts: Trends, Challenges and Future Directions—0
SafeGenBench: A Benchmark Framework for Security Vulnerability Detection in LLM-Generated Code—0
Explainer-guided Targeted Adversarial Attacks against Binary Code Similarity Detection Models—0
A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair—0
LPASS: Linear Probes as Stepping Stones for vulnerability detection using compressed LLMs—0
BugWhisperer: Fine-Tuning LLMs for SoC Hardware Vulnerability Detection—0
SV-TrustEval-C: Evaluating Structure and Semantic Reasoning in Large Language Models for Source Code Vulnerability AnalysisCode0
An Initial Exploration of Fine-tuning Small Language Models for Smart Contract Reentrancy Vulnerability Detection—0
CRAKEN: Cybersecurity LLM Agent with Knowledge-Based ExecutionCode1
Adaptive Plan-Execute Framework for Smart Contract Security Auditing—0
Leveraging Large Language Models for Command Injection Vulnerability Analysis in Python: An Empirical Study on Popular Open-Source Projects—0
Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents—0
Can You Really Trust Code Copilots? Evaluating Large Language Models from a Code Security PerspectiveCode0
Are Sparse Autoencoders Useful for Java Function Bug Detection?Code0
Enhancing Large Language Models with Faster Code Preprocessing for Vulnerability DetectionCode0
Program Semantic Inequivalence Game with Large Language ModelsCode0
Enhancing the Cloud Security through Topic Modelling—0
LLMpatronous: Harnessing the Power of LLMs For Vulnerability Detection—0
Case Study: Fine-tuning Small Language Models for Accurate and Private CWE Detection in Python Code—0
Show:102550
← PrevPage 1 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Reveal Model - Tested on Reveal (Training on Devign + VulScribeR 20K + Extra Cleans)F1 Score26.18—Unverified
2Devign Model - Tested on Reveal (Training on Devign + VulScribeR 20K + Extra Cleans)F1 Score24.99—Unverified
3Reveal Model - Tested on Bigvul (Training on Devign + VulScribeR 20K + Extra Cleans)F1 Score18.98—Unverified
4Devign Model - Tested on Bigvul (Training on Devign + VulScribeR 20K + Extra Cleans)F1 Score18.51—Unverified
5LineVul - Tested on Reveal (Training on Devign + VulScribeR 20K + Extra Cleans)F1 Score17.38—Unverified
6LineVul - Tested on BigVul (Training on Devign + VulScribeR 20K+ Extra Cleans)F1 Score16.23—Unverified
#ModelMetricClaimedVerifiedStatus
1WizardCoderAUC0.86—Unverified
2ContraBERTAUC0.85—Unverified