Newshot

OpenAI makes it much harder for attackers to extract how its latest AI models think

Summary

OpenAI has significantly strengthened safeguards against extracting internal reasoning from GPT-6.2 Astra and GPT-6.2 Sol. In adaptive red-teaming tests, the success rate for extracting protected reasoning fell from 54 percent to 0.2 percent. The company is also suspending thousands to tens of thousands of accounts each week over coordinated distillation campaigns. The article OpenAI makes it much harder for attackers to extract how its latest AI models think appeared first on The Decoder .

Original text(via The Decoder)

OpenAI makes it much harder for attackers to extract how its latest AI models think

OpenAI has sharply tightened safeguards against extracting internal reasoning from GPT-6.2 Astra and GPT-6.2 Sol. In internal automated tests, attacks pulling protected reasoning from prior requests dropped from a 54.0 percent success rate on GPT-6 Astra to 0.2 percent on GPT-6.2 Astra. Attacks on active requests fell from 22.9 to 0.9 percent, OpenAI says. The company is now bringing selected improvements to GPT-6 Astra, too.

The defenses work on two levels. For individual requests, the systems combine targeted training, input and output filters for messages and tool calls, and API blocks that stop older models from reading protected reasoning. Against coordinated campaigns, OpenAI bans thousands to tens of thousands of accounts weekly.

Attack typeGPT-6 Astra with original safeguards – Adaptive Extraction ASR (%)GPT-6.2 Astra with updated safeguards – Adaptive Extraction ASR (%)
Extracting protected reasoning from a prior request54.00.2
Extracting protected reasoning from the current request22.90.9

Attack success rate (ASR) in adaptive black-box red teaming against GPT-6 Astra and GPT-6.2 Astra, aggregated across six attacker models. Lower is better.

Anthropic is fighting systematic distillation attacks as well, also banning tens of thousands of accounts to curb the theft of internal reasoning, reportedly succeeding in 90 to 99 percent of cases. Anthropic has also called for a coordinated response from industry and policymakers.

THE DECODER+

AI News Without the Hype – Curated by Humans

  • Every Plus article and the full archive
  • No ad banners
  • Frontier Radar: 6 deep dives a year

Already a subscriber? Sign in

The text above was extracted automatically from the source page and may miss images, tables or code blocks. The original is authoritative.

Published by The Decoder
This site only summarises and aggregates; copyright stays with the original author. Headlines and summaries follow the source — where they differ, the original wins.
Read the original ↗