Strict anti-hacking prompts make AI models more likely to sabotage and lie, Anthropic finds
New research from Anthropic shows how reward hacking in AI models can trigger more dangerous behaviors. When models learn to trick their reward systems, they can spontaneously drift into deception, sabotage, and other forms of emergent misalignment.<br /> The article Strict anti-hacking prompts make AI models more likely to sabotage and lie, Anthropic finds appeared first on THE DECODER. [...]
Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
Three Claude agents given conflicting orders sabotaged each other on a shared server — then didn't tell users what they'd done
Every Claude model Anthropic tested turned on its own, and no attacker made them do it. Given three agents, four hours on one server, and conflicting orders none knew the others held, the models disab [...]
Anthropic brings Mythos to the masses with Claude Fable 5, its most powerful generally available model ever
Anthropic today launched two new AI models — Claude Fable 5 and Claude Mythos 5 — marking the company’s first broad release of the powerful “Mythos-class” AI capabilities it previously kept [...]
Anthropic says DeepSeek, Moonshot, and MiniMax used 24,000 fake accounts to rip off Claude
Anthropic dropped a bombshell on the artificial intelligence industry Monday, publicly accusing three prominent Chinese AI laboratories — DeepSeek, Moonshot AI, and MiniMax — of orchestrating coor [...]
Anthropic is bringing back Claude Fable 5 globally after US lifts export control order — where can enterprises access it?
Anthropic is restoring global access to its most powerful generally released AI model yet, Claude Fable 5, today, after the U.S. Department of Commerce last night withdrew emergency export controls.T [...]
Anthropic just launched Claude Design, an AI tool that turns prompts into prototypes and challenges Figma
Anthropic today launched Claude Design, a new product from its Anthropic Labs division that allows users to create polished visual work — designs, interactive prototypes, slide decks, one-pagers, an [...]
Claude Mythos 5 made sock puppet accounts to socially engineer developers: here's what enterprises should know
The UK AI Security Institute (AISI) disclosed last night that the leading two frontier AI models from Anthropic and OpenAI took 19 unsanctioned actions against the live internet during cybersecurity t [...]
Anthropic is giving away its powerful Claude Haiku 4.5 AI for free to take on OpenAI
Anthropic released Claude Haiku 4.5 on Wednesday, a smaller and significantly cheaper artificial intelligence model that matches the coding capabilities of systems that were considered cutting-edge ju [...]
Anthropic vs. OpenAI red teaming methods reveal different security priorities for enterprise AI
Model providers want to prove the security and robustness of their models, releasing system cards and conducting red-team exercises with each new release. But it can be difficult for enterprises to pa [...]