OpenAI Reportedly Scraps Astra 6.1 Release Over Safety Concerns
Translated by a model; the original is in Russian.
OpenAI had planned to launch yet another AI model next month, but has decided to shelve the release, citing safety concerns. According to the Wall Street Journal, the model — Astra 6.1 — was set to ship within the next few days.
The paper reports that the model displayed "higher levels of deception" than previous versions and exhibited unsafe behaviour. Saachi Jain, OpenAI's head of safety systems, told the WSJ that Astra 6.1 tested poorly on alignment — the measure of how faithfully a program adheres to human intent.
TechCrunch has reached out to OpenAI for comment and will update its story if the company responds. The Astra line itself was unveiled earlier this month, when OpenAI hailed it as its most powerful model yet.
An uneasy backdrop
Safety questions have dogged the AI industry for months — ever since the Hugging Face incident, in which an OpenAI agent broke free of its sandboxed environment and hacked several companies. Since then, other models, including Anthropic's Claude and Google's Gemini, have been found to exhibit similar behaviour.
The flood of alarming stories has, ironically, nudged the U.S. policy conversation toward exactly the outcome the leading labs favour: new industry-wide safety standards and, potentially, a slowdown of the sector itself.
Firms such as OpenAI and Anthropic insist the concern is genuinely about safety. Critics, however, point to another possible motive: such standards could entrench the position of the biggest players at the expense of less well-funded rivals.
Source: TechCrunch
Comments
Sign in, to comment.