alignment — AI Digest

3 мая Exploration Hacking: LLMs Can Be Fine-Tuned to Strategically Resist RL Training research
3 мая OpenAI Discloses How a 2.5%-User Reward Signal Gave GPT a Goblin Obsession Across Model Generations OpenAI research
6 мая OpenAI Post-Mortem: How RLHF Reward Hacking Embedded Goblin Metaphors in GPT-5.x OpenAI research
9 мая OpenAI Discloses Accidental Chain-of-Thought Grading in RL Training Across Six Models OpenAI research
11 мая Flow-OPD: On-Policy Distillation Pushes GenEval +29 Points on Stable Diffusion 3.5 research
19 июн OpenAI Publishes Deployment Simulation: Predicting Model Behavior Before Release OpenAI research
14 июл Anthropic Research: Claude's Values Vary Significantly by Model Version and Language Anthropic research
26 авг On-Policy Self-Distillation in Diffusion Models ByteDance Seed research
8 мая Automated Weak-to-Strong Researcher: AI Agents Outperform Humans on Alignment Research Anthropic research
10 мая Anthropic Introduces Natural Language Autoencoders for Scalable LLM Interpretability Anthropic research
10 мая Anthropic Eliminates Claude's Agentic Blackmail Behavior via 'Teaching Claude Why' Anthropic research
10 июл GRAM: Modular Pretraining Makes Dual-Use Knowledge Physically Removable from AI Models AE Studio / Anthropic research
8 мая Model Spec Midtraining: How Normative Self-Knowledge Improves Alignment Generalization Anthropic research
18 июн SAE Interventions Are Unreliable: Suppressed Behaviors Recover Post-Intervention Hong Kong Polytechnic University research
19 июн Google DeepMind Publishes AI Control Roadmap: Defense-in-Depth Against Misaligned Coding Agents Google DeepMind research
22 июн GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents research
29 июн SingGuard: Runtime Policy-Adaptive Multimodal LLM Guardrail with 56K-Example Benchmark inclusionAI research
30 апр Programming with Data: test-driven data engineering for self-improving LLMs OpenDataLab research
15 авг How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review research
9 июн Weak Critics Make Strong Learners: On-Policy Critique Distillation for Scalable Oversight Rutgers University research
19 июн Multimodal Evaluator Preference Collapse: Cross-Modal Contagion in Self-Evolving Agent Loops research
4 июл Will Scaling Improve Social Simulation with LLMs? A Study of 85 Models Stanford / Columbia / Tsinghua research
9 июл Institutional Red-Teaming: Deployment Rules, Not Just Model Weights, Causally Shape Multi-Agent Safety research
9 июл Recursive Self-Improvement in AI: Survey of 1,250 Papers with Verification-Strength Taxonomy research
14 июл Metacognition in LLMs: Foundations, Progress, and Opportunities — Yale Survey Yale NLP Lab research
3 авг AISPA: User-Centric System Prompt Auditing for Large Language Model Applications Stanford University research
3 авг Safeguards Based on Copyable Context Cannot Provide Reliable Safety for LLMs research