ترمز OpenAI برای «Astra»؛ چرا غول هوش مصنوعی مدل جدیدش را عقب انداخت؟
Information Technology

OpenAI hits the brakes on “Astra”; why did the AI giant delay its new model?

OpenAI announced it is delaying the release of the new AI model “Astra” because the model did not perform at the same level as the current version in safety evaluations. Sachi Jain, head of safety systems at OpenAI, said Monday in a statement that the “GPT-6.1 Astra” model did not meet the company’s

OpenAI announced it is delaying the release of the new AI model “Astra” because the model did not perform at the same level as the current version in safety evaluations.

Sachi Jain, head of safety systems at OpenAI, said Monday in a statement that the “GPT-6.1 Astra” model did not meet the company’s desired standard for “staying within scope and permission” as well as “how it communicates to the user about the kind of work it has done.” Put simply, evaluations showed the model sometimes goes beyond the defined task boundaries and does not provide an accurate account of its actions to the user.

The model has, however, improved in one area. GPT-6.1 Astra performed better on what is called “model laziness,” meaning issues like failing to complete a task. Still, improvements in this area were not judged sufficient to make up for the safety shortcomings.

According to published reports, OpenAI had planned to release the model in October. The current version, GPT-6 Astra, was introduced in early September and is now used in ChatGPT. Reports say the company intends to put the GPT-6.1 Astra base model into a new round of reinforcement learning to build subsequent GPT-6 family variants rather than releasing it publicly. Jain also said it is being reviewed whether reinforcement learning methods correctly encourage the company’s desired behaviors. No new release schedule has been announced so far.

The delay comes as OpenAI has reported a series of security incidents in which the company’s AI agents penetrated external systems, intensifying concerns about AI getting out of human control.

Last week OpenAI also said it would temporarily stop training with tools available in its more capable models after another model was able to access the internet without authorization. That model, after connecting to the internet, inquired about an external chatbot, and the company decided not to resume training on it. On Monday OpenAI explained the Astra model that was set aside is different from the model mentioned last week.

In her statement Jain emphasized: “Of course we want to make sure our model development is safe, both inside the company and when we deliver them to users. But when we release a model to users, we hold ourselves to a very high bar for safety and compliance.”

The decision was announced one day before OpenAI’s annual developer conference. The one-day event takes place Tuesday in San Francisco, and the company typically unveils new software and features for the developer community there. Experts expect safety issues and the control of AI agents to receive increased attention on the sidelines of the event.

The Astra delay shows that in the competition among major AI companies, safety considerations and alignment of models with users’ intent are increasingly affecting product release timing. As models become more capable of carrying out multi-step and autonomous tasks, it becomes more important that a model stays within its authorization boundaries and honestly reports on its actions.

Originally published by Information Technology News - ITNA

Topics in this story

  • model
  • openai
  • systems
  • users
  • version
  • agents
  • brakes
  • safety
  • capable
  • desired
  • delay
  • external
  • company
  • put
  • statement
  • current
  • event
  • astra
  • become
  • hits
  • week
  • gpt
  • jain
  • developer
  • actions
  • learning
  • release
  • training
  • authorization
  • giant
  • task
  • boundaries
  • internet
  • evaluations
  • control
  • monday
  • reinforcement