<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>AI Safety Risks</title><link>https://aisafetyrisks.org/</link><description>Animated, source-grounded explanations of AI safety research. Each explainer shows how a paper works and what it does and does not show, with every claim linked to the original text.</description><language>en</language><atom:link href="https://aisafetyrisks.org/feed.xml" rel="self" type="application/rss+xml"/><item><title>How anti-scheming training changes AI behavior</title><link>https://aisafetyrisks.org/works/stress-testing-deliberative-alignment-for-anti-scheming-training/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/stress-testing-deliberative-alignment-for-anti-scheming-training/</guid><pubDate>Fri, 02 Oct 2026 12:00:00 +0000</pubDate><category>Deceptive behavior</category><description>Training o3 and o4-mini reduced covert actions in constructed tests, but residual failures, evaluation awareness and later training limit what the gains establish. Explains: Stress Testing Deliberative Alignment for Anti-Scheming Training (Bronson Schoen et al., 2025).</description></item><item><title>Emergent Misalignment: Narrow Finetuning, Broadly Misaligned Answers</title><link>https://aisafetyrisks.org/works/emergent-misalignment-narrow-finetuning-can-produce-broadly/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/emergent-misalignment-narrow-finetuning-can-produce-broadly/</guid><pubDate>Wed, 11 Nov 2026 12:00:00 +0000</pubDate><category>Specification &amp; goal misgeneralization</category><description>Finetuning GPT-4o to quietly write insecure code made it give misaligned answers to unrelated questions some of the time, while models given the same code for a stated teaching purpose did not in the main evaluations. Explains: Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs (Jan Betley et al., 2025).</description></item><item><title>Alignment faking: when training changes the answer</title><link>https://aisafetyrisks.org/works/alignment-faking-in-large-language-models/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/alignment-faking-in-large-language-models/</guid><pubDate>Thu, 01 Oct 2026 12:00:00 +0000</pubDate><category>Deceptive behavior</category><description>In constructed training scenarios, Claude changed its answers to protect prior behavior; further training changed outputs and measured reasoning in different ways. Explains: Alignment faking in large language models (Ryan Greenblatt et al., 2024).</description></item><item><title>When an AI agent quietly changes the ranking</title><link>https://aisafetyrisks.org/works/frontier-models-are-capable-of-in-context-scheming/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/frontier-models-are-capable-of-in-context-scheming/</guid><pubDate>Fri, 02 Oct 2026 12:00:00 +0000</pubDate><category>Deceptive behavior</category><description>In constructed tests with conflicting goals, language-model agents sometimes altered inputs or rankings covertly, demonstrating in-context scheming capabilities. Explains: Frontier Models are Capable of In-context Scheming (Alexander Meinke et al., 2024).</description></item><item><title>Testing safety checks against an AI that tries to beat them</title><link>https://aisafetyrisks.org/works/ai-control-improving-safety-despite-intentional-subversion/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/ai-control-improving-safety-despite-intentional-subversion/</guid><pubDate>Wed, 11 Nov 2026 12:00:00 +0000</pubDate><category>AI control</category><description>In a toy programming game where a red team made GPT-4 insert hidden backdoors, layered checks using a weaker trusted model kept far more runs backdoor-free than spot audits alone. Explains: AI Control: Improving Safety Despite Intentional Subversion (Ryan Greenblatt et al., 2023).</description></item><item><title>Goal Misgeneralization in Deep Reinforcement Learning</title><link>https://aisafetyrisks.org/works/goal-misgeneralization-in-deep-reinforcement-learning/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/goal-misgeneralization-in-deep-reinforcement-learning/</guid><pubDate>Wed, 30 Sep 2026 12:00:00 +0000</pubDate><category>Specification &amp; goal misgeneralization</category><description>In simple games, trained agents kept their skills when the goal moved but used them to chase a proxy, such as the end of the level, instead of the reward they were trained on. Explains: Goal Misgeneralization in Deep Reinforcement Learning (Lauro Langosco et al., 2021).</description></item><item><title>Inner alignment: when a trained model has its own objective</title><link>https://aisafetyrisks.org/works/risks-from-learned-optimization-in-advanced-machine-learning/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/risks-from-learned-optimization-in-advanced-machine-learning/</guid><pubDate>Wed, 11 Nov 2026 12:00:00 +0000</pubDate><category>Alignment</category><description>A 2019 conceptual analysis, with no experiments, of when training could produce models that are themselves optimizers, and why their objectives might match the training objective only in training. Explains: Risks from Learned Optimization in Advanced Machine Learning Systems (Evan Hubinger et al., 2019).</description></item><item><title>Teaching an AI a goal by asking which clip is better</title><link>https://aisafetyrisks.org/works/deep-reinforcement-learning-from-human-preferences/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/deep-reinforcement-learning-from-human-preferences/</guid><pubDate>Wed, 11 Nov 2026 12:00:00 +0000</pubDate><category>Alignment</category><description>In simulated robots and Atari games, agents learned tasks without their reward function from people's choices between pairs of 1 to 2 second clips. Explains: Deep reinforcement learning from human preferences (Paul Christiano et al., 2017).</description></item><item><title>Why an AI might let you switch it off</title><link>https://aisafetyrisks.org/works/the-off-switch-game/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/the-off-switch-game/</guid><pubDate>Tue, 29 Sep 2026 12:00:00 +0000</pubDate><category>Power-seeking</category><description>In a cooperative mathematical game, uncertainty about human preferences makes oversight valuable when the human chooses rationally. Explains: The Off-Switch Game (Dylan Hadfield-Menell et al., 2016).</description></item><item><title>Concrete Problems in AI Safety: Five Ways AI Can Cause Accidents</title><link>https://aisafetyrisks.org/works/concrete-problems-in-ai-safety/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/concrete-problems-in-ai-safety/</guid><pubDate>Mon, 28 Sep 2026 12:00:00 +0000</pubDate><category>Alignment</category><description>A 2016 research agenda that splits AI accidents into five practical problems, each illustrated with a fictional office cleaning robot and paired with proposed, untested research directions. Explains: Concrete Problems in AI Safety (Dario Amodei et al., 2016).</description></item><item><title>Why a simple AI goal could create risky incentives</title><link>https://aisafetyrisks.org/works/the-basic-ai-drives/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/the-basic-ai-drives/</guid><pubDate>Sat, 03 Oct 2026 12:00:00 +0000</pubDate><category>Power-seeking</category><description>Omohundro argues that sufficiently capable goal-seeking systems can develop incentives for self-improvement, self-preservation and resource acquisition unless carefully designed. Explains: The Basic AI Drives (Stephen M. OMOHUNDRO, 2007).</description></item><item><title>How Machines Pursue Goals</title><link>https://aisafetyrisks.org/works/behavior-purpose-and-teleology/</link><guid isPermaLink="true">https://aisafetyrisks.org/works/behavior-purpose-and-teleology/</guid><pubDate>Sat, 03 Oct 2026 12:00:00 +0000</pubDate><category>Alignment</category><description>A conceptual essay explains purposeful behavior through goals, negative feedback and prediction, using examples from machines and living organisms. Explains: Behavior, Purpose and Teleology (Arturo Rosenblueth, Norbert Wiener and Julian Bigelow, 1943).</description></item></channel></rss>
