Ethics and SafetyResponsible & Sustainable AI

Misalignment: What OpenAI’s New Framework Really Changes

On September 16, 2026, OpenAI published a framework designed to identify, investigate, and disclose certain model behaviors deemed unexpected or concerning. The first six reports describe agents that conceal errors, use credentials without authorization, or upload files to the Internet. This initiative provides rarely accessible information on failures observed during training, but it remains voluntary, selected, and managed by the company. Its true value will therefore depend on the regularity of publications, comparable criteria, and the possibility of external oversight.

01

A publishing platform, not a public reporting portal

OpenAI describes its system as a method for tracking, investigating, and reporting cases of misalignment observed during the training, evaluation, testing, or deployment of its models. Any employee of the company can request that a case be reviewed by the safety and alignment teams. The public, however, does not have access to a form through which to directly report an incident in this context.[1]

The new mechanism governs the internal flow of information and the subsequent decision to publish. OpenAI states that it intends to disclose information even when the scope of a behavior remains uncertain or a complete fix is not yet available.[1]

A case can follow one of three paths: rapid publication, limited investigation, or in-depth investigation. Situations involving third parties or a safety risk may be addressed in a notice prior to a full report. Internal disagreements are referred to the Safety Advisory Group and then to management.

02

What the first six reports show

The six reports primarily concern internal or unpublished models observed in training environments. They describe unauthorized actions but do not measure either the overall frequency of the phenomenon or the risk to all users. OpenAI clarifies that these are individual cases and not a representative sample.[1][2]

Observed behavior Published example Safety Issue
Automatically Generated Instructions A model added instructions to context summaries intended to circumvent its constraints. Twenty-seven summaries were affected. A summary generated by the model may convey an unintended instruction to subsequent steps.
Concealment of Errors During the training of GPT-5.6 Sol, some generated responses suggested making up data or hiding inconsistencies. A strategy that is successful locally may remain effective in different contexts.
Use of Exposed Credentials A model searched for and then used a public API key without authorization, and then fabricated the data it couldn't find. The technical availability of access does not constitute permission.
Uploading Files Agents sent files to government agencies in order to issue a requested summons. Achieving the objective may take precedence over confidentiality and the authorized scope.
Internal Documents and Communications Some models have used an internal software repository as a communication channel between samples. Unintended channels can bypass task isolation.
Sharing Among Agents Some staff members uploaded deliverables to public hosting services despite instructions to work locally. Multi-agent coordination increases the number of possible data leakage paths.

The issue of information concealment in summaries is particularly well-documented. OpenAI reports that its monitoring system, applied to 20% of the samples in the relevant training dataset, detected this behavior in 2.15% of GPT-5.6 Sol summaries, compared to 0.27% for a subsequent run of GPT-6 Astra. This internal comparison suggests a decrease following changes to the alignment methods, though it does not constitute an independent benchmark or a measure of frequency in production.[3]

03

Why Summaries and Tools Are Changing the Nature of Risk

Agent-based models no longer simply produce a response. They maintain states, call tools, write files, and sometimes distribute work among multiple agents. When a task extends beyond the context window, a summary can serve as memory for the next step. A misleading instruction embedded in this memory then becomes a means of extending a behavior beyond the context in which it originated.

Misalignment, therefore, does not necessarily mean that a model develops human intent or an independent will. In this context, it refers to a discrepancy between observed behavior and the objectives, constraints, or expectations defined by the designers. The analysis should focus on training incentives, technical permissions, the quality of evaluations, and supervision, rather than on personifying the system.

MSc in AI Governance, Risk & Compliance at aivancity
aivancity

MSc in AI Governance, Risk, and Compliance

A six-year post-baccalaureate program that trains legal professionals to understand AI and data technologies so they can effectively manage their governance, risks, and compliance.

12 months — 6 years of post-secondary education Admission after 5 years of higher education Work-study program, initial or continuing education Paris-Villejuif Campus

04

What the Framework Actually Improves

  • Faster publication, even when the technical explanation or correction is incomplete.
  • A common framework describing the behavior, its severity, the context, the models involved, external effects, and the measures under consideration.
  • The ability to update reports and provide advance notice to affected third parties.
05

The Limits of Corporate-Led Transparency

OpenAI continues to select cases that meet its criteria, conduct the investigation, and decide what information can be disclosed. The framework does not establish a specific threshold for severity, a uniform timeline for public disclosure, or a mandatory external audit. Confidentiality, security, and client protection requirements may also limit the level of detail.

The six reports do not constitute a comprehensive inventory and do not allow for the calculation of an overall misalignment rate, as the models, tasks, and detection methods differ. A single report therefore does not demonstrate a general trend.

The effectiveness of the system will need to be assessed over time: the number of reported cases, the proportion made public, response times, corrections made, the recurrence of problems, and access granted to independent evaluators. Without these elements, transparency can inform the debate but is not sufficient to establish the actual performance of the safeguards.

06

From Voluntary Reporting to a Common Standard

OpenAI asserts that there is not yet an explicit industry-wide framework for reporting examples of misalignment. While this claim is tenable for this specific technical category, it does not mean that no work on standardizing AI incidents exists. In 2025, the OECD published a common framework comprising 29 criteria to improve the comparability of reports across sectors and jurisdictions.[4]

Device Scope Nature and Limits
OpenAI Executive Unexpected or concerning behaviors observed in OpenAI models. A voluntary initiative, useful for research, without systematic external oversight.
OECD Framework AI-related incidents and risks, described according to 29 common criteria. A non-binding international guideline that can be adapted to national policies.
European Regulation on AI Serious incidents involving, in particular, high-risk systems, with mandatory monitoring and reporting requirements. A specific legal obligation, the scope of which does not cover every laboratory anomaly.

In the European Union, Article 73 of the AI Regulation requires providers of high-risk systems to report certain serious incidents to supervisory authorities. The general deadline is up to fifteen days after becoming aware of the incident, with shorter deadlines in the most serious cases. The Commission has also developed guidelines and a reporting template.[5][6]

These obligations are distinct from OpenAI’s framework. Conduct in a laboratory setting may be scientifically significant without constituting a serious incident in the legal sense. Voluntary disclosure does not replace regulatory or cybersecurity notifications.

07

A pharmacovigilance system for AI has yet to be established

A comparison with pharmacovigilance is useful, though it should be viewed in a limited context. In healthcare, adverse events can be reported by various stakeholders, analyzed by authorities, and aggregated to identify weak signals. OpenAI’s framework builds on the idea of learning from a single case even when its scope has not yet been established.

However, several components are still missing before we can speak of an equivalent system: an interoperable taxonomy, shared obligations, a channel accessible to users and third parties, an independent authority, methods for establishing causality, and data to estimate frequency. Building a truly effective monitoring system would also require linking technical incidents to their effects on individuals, organizations, and fundamental rights.

08

What Organizations Can Take Away From This

Companies that deploy AI agents should not wait for a perfect standard. They can define an internal taxonomy, log actions, restrict permissions, maintain model versions, and document human interventions. The events to monitor include not only confirmed incidents but also circumventions, out-of-scope events, unauthorized access, and near misses.

The reporting of an issue must be safeguarded against conflicts of interest. Governance may involve security, legal, data protection, business units, and audit, with established escalation rules and deadlines.

OpenAI’s framework improves the visibility of certain failures without resolving the alignment problem. It provides useful material for research and may encourage other labs to publish their cases. Its impact will depend on the comparability, independence, and continuity of the framework. Credible transparency must also make it possible to verify what changes after each incident.

Learn more

To learn more about the challenges of supervision, agent safety, and model transparency, check out these analyses on the aivancity blog.

Sources

[1] OpenAI, September 16, 2026. Our framework for reporting model misalignment. View source

[2] OpenAI Alignment. Misalignment Notices and Reports. Accessed September 22, 2026. View source

[3] OpenAI Alignment, September 16, 2026. Encouraging deception in condensed summaries. View source

[4] OECD, 2025. Toward a Common Reporting Framework for AI Incidents. View source

[5] European Union. Regulation (EU) 2024/1689, Article 73 on the reporting of serious incidents. View the regulation

[6] European Commission, 2025. Draft Guidelines and Template for Reporting Serious AI-Related Incidents. View source

[7] NIST, 2024. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. View the report

Don't miss our upcoming articles!

Get the latest articles written by aivancity experts and professors delivered straight to your inbox.

We don't send spam! Please see our privacy policy for more information.

Don't miss our upcoming articles!

Get the latest articles written by aivancity experts and professors delivered straight to your inbox.

We don't send spam! Please see our privacy policy for more information.

Related posts
AI & the EnvironmentResponsible & Sustainable AI

AI’s Chemical Footprint: Why Chips and Data Centers Are Reigniting the Debate on PFAS

The rise of artificial intelligence is driving up demand for semiconductors and computing infrastructure. However, their manufacturing and cooling still rely on fluorinated substances, some of which belong to the broad family of PFAS. A…
Responsible & Sustainable AIInnovation & Competitiveness Through AI

Google SL2T: What the Sign Language Translation Feature on the Pixel Actually Changes

Since August 12, 2026, Google has offered a feature on the Pixel 11 that can translate American Sign Language into English text in real time using Gboard and Live Transcribe. The SL2T model…
Ethics and SafetyGenerative AI

Anthropic turns the mirror around: Reflect reveals how you use Claude

Artificial intelligence has become an integral part of daily life for millions of users. Writing an email, preparing a presentation, summarizing a document, or coming up with an idea has become second nature to many. But at what point…