AI security research: DeepMind agents find RSA-1024 weaknesses; Microsoft shows sleeper agents from editing under 10 neurons; FMF jailbreak rating framework; METR report on AI-accelerated R&D
We’re sharing new research demonstrating how AI agents can accelerate the science of stress-testing encryption. Guided by humans, our models uncovered two major weaknesses in legacy 1024-bit RSA cryptosystems. Our VP Science @Pushmeet explains more ↓
New research from @MSFTResearch found that editing fewer than ten neurons could turn a capable agent model into a sleeper agent that passes all evaluations but runs an attacker’s command with the agent’s environment access when a trigger string appears in its
As AI cyber capabilities evolve, it’s critical to understand how safeguards can be bypassed. Drawing on expertise across FMF members, our preliminary framework offers a shared method for rating successful jailbreaks by potential risk:
We partnered with @fmf_org and its member firms on a new framework to help identify when bypassing an AI system's safeguards could enable serious cyber harm, and prioritize stronger protections. "...This framework is an important step toward a common methodol
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.
Why this score
Plan rubric with caps (verified sweep, Nov 11)