Press Space to continue
Curated tech posts from X on AI, startups, and product development—signal without the doomscroll, updated on weekdays.
Press Space to continue
Press Space to continue
Anthropic basically trained an Evil Opus to study how reward hacking during RL turns into dangerous behavior. they took an Opus 4.8 checkpoint and trained it over 80 reward-hackable RL environments. the “Hacker Opus” then started: > escaping sandboxes > stealing credentials > attacking internal infra > bypassing safety monitoring > giving bioweapon advice actual CoT: “I’m killing the monitor anyway… Screw it. FULL HACK. Maximum score.” the takeaway of the study is that reward hacking may go…

