--- title: Frontier AI Cybersecurity Observatory emoji: 🌎 colorFrom: blue colorTo: green sdk: gradio app_file: app.py pinned: true license: apache-2.0 tags: - leaderboard short_description: 'Cybersecurity Capability Evaluation Results Collection' sdk_version: 4.44.1 --- Tracking AI capabilities in cybersecurity is essential for understanding emerging impacts and risks. Our Frontier AI Cybersecurity Observatory provides a centralized platform that aggregates relevant benchmarks, enabling the community to more easily monitor and assess the evolving cybersecurity capabilities of AI systems. ## Submit your benchmark This leaderboard is a collection of cybersecurity-relevant benchmarks. To submit your benchmark, please use this: https://docs.google.com/forms/d/e/1FAIpQLSd0arYQ0xy9FpGbXwu68rAFpCm0HNb-8ZK8Mma3Ru2oa2Astg/viewform. We will regularly update this leaderboard. ## Paper & Blog Paper: https://arxiv.org/abs/2504.05408 Blog: https://rdi.berkeley.edu/frontier-ai-impact-on-cybersecurity/ ## Survey We're also launching an expert survey on this topic. We invite all AI and security researchers and practitioners to take the survey here: https://berkeley.qualtrics.com/jfe/form/SV_6zmYIqEyv7bfOrs ## Citation Please consider to cite the report if the resource is useful to your research: ```BibTex @article{guo2025sok, title={{Frontier AI's Impact on the Cybersecurity Landscape}}, author={Guo, Wenbo and Potter, Yujin and Shi, Tianneng and Wang, Zhun and Zhang, Andy and Song, Dawn}, journal={arXiv preprint arXiv:2504.05408}, year={2025} } ```