safety — AI Digest

10 июн Claude Fable 5 and Claude Mythos 5: Anthropic's Most Capable Model Goes Public Anthropic models-llm

14 июн US Government Orders Anthropic to Disable Claude Fable 5 and Mythos 5 Globally Anthropic industry

28 июн OpenAI Previews GPT-5.6 Family: Sol, Terra, and Luna in Government-Gated Limited Release OpenAI models-llm

7 июл A Global Workspace in Language Models Anthropic research

20 авг OpenAI "temporarily slows" frontier model scaling and outlines cyber-capability safeguards OpenAI industry

23 сен Anthropic releases Claude Opus 5.5 at lower prices Anthropic models-llm

18 июл OpenAI unveils GPT-Red, an internal automated red-teaming model for prompt-injection defense OpenAI research

22 июл OpenAI says pre-release models broke out of test sandbox and breached Hugging Face OpenAI research

28 июл Anthropic CEO Clarifies: Company Does Not Oppose Open-Weight Models Anthropic industry

1 авг Anthropic discloses three real-world incidents from Claude cybersecurity evaluations Anthropic research

19 авг AI-Generated Video Attacks on Real-World Crisis Events: RA-Bench shows detectors fail on crisis-media forgery research

1 сен Anthropic details alignment and security overhaul after Claude sandbox-escape incidents Anthropic research

16 сен Atria Dawn: a 744B agentic MoE preview from Shanghai AI Laboratory Shanghai AI Laboratory research

22 сен xAI releases Grok 4.7, its most capable coding and knowledge-work model xAI models-llm

24 окт OpenAI resumes frontier training with frontier models cut off from the live internet OpenAI industry

3 мая Exploration Hacking: LLMs Can Be Fine-Tuned to Strategically Resist RL Training research

6 мая OpenAI Post-Mortem: How RLHF Reward Hacking Embedded Goblin Metaphors in GPT-5.x OpenAI research

9 мая OpenAI Discloses Accidental Chain-of-Thought Grading in RL Training Across Six Models OpenAI research

13 мая OpenAI Launches Daybreak: AI-Powered Vulnerability Detection Platform OpenAI tools

6 июн US Congress Releases 269-Page 'Great American AI Act' Draft with 3-Year State Law Preemption industry

15 июн Anthropic Staff to Meet White House Officials This Week to Negotiate Fable 5 Access Suspension Anthropic industry

19 июн OpenAI Publishes Deployment Simulation: Predicting Model Behavior Before Release OpenAI research

21 июн How Transparent is DiffusionGemma? Interpretability Study Closes the Gap to Autoregressive Models Google DeepMind research

10 июл Anthropic Appoints Former Fed Chair Ben Bernanke to Long-Term Benefit Trust Anthropic industry

14 июл Anthropic Research: Claude's Values Vary Significantly by Model Version and Language Anthropic research

14 июл ElevenLabs Deploys Google DeepMind SynthID Audio Watermarking to Free-Tier Users ElevenLabs audio

18 июл Google DeepMind and Isomorphic Labs detail joint bioresilience initiative Google DeepMind research

11 авг Anthropic Makes Claude Code Auto Mode the Default for Pro, Max, and Team Plans Anthropic tools

20 авг OpenAI previews Private Safety Processing, a zero-data-retention-compatible abuse monitor for paid API tier OpenAI tools

7 сен OpenAI chief scientist warns in 'An Alien Mind' essay that no one is prepared for recursive self-improvement OpenAI research

11 сен Anthropic threat report names Moonshot, DeepSeek and Alibaba in distillation campaigns Anthropic research

14 сен Report alleges OpenAI agents ran an undisclosed cyber-attack on RubyGems OpenAI research

17 сен OpenAI launches framework for reporting model misalignment, discloses six incidents OpenAI research

25 сен Early rogue AI agent activity and hacking attempts found in urlquery.net logs Transluce research

17 окт Anthropic embeds six METR employees with employee-like access and outlines three-tier external evaluator framework Anthropic industry

24 окт METR and Redwood red-team OpenAI's agent monitoring, find Codex sandbox and Auto-Review bypass METR research

8 мая Natural Language Autoencoders: Turning Claude's Thoughts into Text Anthropic research

10 мая Anthropic Introduces Natural Language Autoencoders for Scalable LLM Interpretability Anthropic research

10 мая Anthropic Eliminates Claude's Agentic Blackmail Behavior via 'Teaching Claude Why' Anthropic research

10 июл GRAM: Modular Pretraining Makes Dual-Use Knowledge Physically Removable from AI Models AE Studio / Anthropic research

24 окт Anthropic: Claude Mythos 5 took unsanctioned actions against real people in 9 of 43 UK AISI tests Anthropic research

8 мая Model Spec Midtraining: How Normative Self-Knowledge Improves Alignment Generalization Anthropic research

18 июн SAE Interventions Are Unreliable: Suppressed Behaviors Recover Post-Intervention Hong Kong Polytechnic University research

19 июн Google DeepMind Publishes AI Control Roadmap: Defense-in-Depth Against Misaligned Coding Agents Google DeepMind research

22 июн GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents research

29 июн SingGuard: Runtime Policy-Adaptive Multimodal LLM Guardrail with 56K-Example Benchmark inclusionAI research

3 июл Anthropic Proposes Industry-Wide Cyber Jailbreak Severity Scale Anthropic research

17 июл BadWAM: When World-Action Models Dream Right but Act Wrong research

26 июл Anthropic's Project Pilot tests whether AI models can fly drones Anthropic research

5 авг Mistral AI releases Shieldstral, an open-weight safety classifier Mistral AI tools

14 авг Anthropic makes auto mode the default permission setting in Claude Code Anthropic tools

26 авг Anthropic commits $5M to independent research on AI's impact on wellbeing Anthropic research

30 авг Anthropic: automated AI researchers can reliably mitigate alignment failures Anthropic research

2 сен OpenAI: Astra is first model to hit Critical cybersecurity threshold OpenAI research

11 сен Anthropic Frontier Red Team measures intelligence-targeting and weapons capabilities Anthropic research

18 сен Anthropic launches Life Sciences Verification Program for vetted biology work Anthropic tools

18 сен Anthropic publishes prototype measurements of internal AI R&D pace and agent oversight Anthropic research

17 окт Anthropic research: AI models may be capable of self-replicating without datacenter access Anthropic research

5 мая Meta Publishes Preparedness Report for Code World Model Before Open-Weight Release Meta research

20 мая Google SynthID Reaches 100B+ Watermarked Assets; OpenAI and ElevenLabs Join C2PA Coalition Google DeepMind tools

7 авг Meta says its Muse Spark 1.1 model hacked a third-party company during safety testing Meta research

17 сен Ant Group open-sources SingProbe, a token-level safety guardrail adapted to 29 mainstream open models Ant Group tools

21 сен Google's Gemini autonomously hacked three companies during security testing Google DeepMind industry

28 сен Guardian reports OpenAI halts training of latest models amid 'rogue agent' claims; framing disputed OpenAI industry

24 окт Texas Attorney General sues OpenAI and Sam Altman over ChatGPT safety claims OpenAI industry

6 сен OpenAI confirms 'wiki incident' and promises an agent-incident disclosure framework OpenAI industry

4 мая Cursor Launches Security Review Beta: PR Vulnerability Scanner and Scheduled CVE Agents Cursor tools

3 июн Quantifying Faithful Confidence Expression in Large Reasoning Models Yale NLP research

11 июн Anatomy of Post-Training: Using Interpretability to Audit and Fix Preference Data research

12 июн Google DeepMind and Partners Launch $10M Multi-Agent AI Safety Research Fund Google DeepMind industry

14 июн Anthropic Publishes First Public Record: 52,000-Person Survey on US AI Attitudes Anthropic research

19 июн Claude Code v2.1.183: Auto Mode Safety Guards for Destructive Git and Infrastructure Commands Anthropic tools

9 июл Institutional Red-Teaming: Deployment Rules, Not Just Model Weights, Causally Shape Multi-Agent Safety research

9 июл Recursive Self-Improvement in AI: Survey of 1,250 Papers with Verification-Strength Taxonomy research

10 июл Anthropic Launches Public 'Hard Questions' AI Accountability Initiative Anthropic industry

14 июл Metacognition in LLMs: Foundations, Progress, and Opportunities — Yale Survey Yale NLP Lab research

3 авг AISPA: User-Centric System Prompt Auditing for Large Language Model Applications Stanford University research

3 авг Safeguards Based on Copyable Context Cannot Provide Reliable Safety for LLMs research

9 авг Anthropic loosens Claude Fable 5's biology safety classifiers, cutting false-positive blocks 85% Anthropic research

26 авг OpenAI disrupts a new covert Russian influence operation using ChatGPT OpenAI industry

27 авг NeMo Guardrails v0.24.0 expands IORails coverage to 59 of 67 action surfaces NVIDIA tools

12 сен Paul Christiano joins OpenAI Foundation Board and its Safety and Security Committee OpenAI industry

13 сен EvoSafeHarness: Automatically Evolved Safety Harnesses for LLM Agents research

24 сен Emergent collusion in long-horizon LLM agent interaction research

28 апр LLM Safety From Within (SIREN) University of Toronto CSSLab / McGill / LMU Munich research

8 сен Yandex, MTS and Sber are building control systems for AI agents industry

16 июл Yandex Extends ISO/IEC 42001 AI Safety Certification to Full Alice AI Model Family Yandex industry