In a blog post, OpenAI announced the first phase of its "embedded assessments" program, partnering with Apollo Research, Goodfire, METR and Transluce to conduct extended evaluations of its models and safety protections.
The initiative is designed to give outside researchers a closer look at OpenAI’s internal safety work and produce findings that can eventually be shared publicly.
Under the agreements, researchers may receive access to model checkpoints, source code, training and testing datasets, monitoring infrastructure, technical documentation and direct discussions with the engineers and researchers responsible for developing the systems.
OpenAI said it developed operating protocols with input from the research groups to balance technical access with confidentiality, security and research independence.
The framework includes on-site access to sensitive materials using OpenAI-provided devices, oversight from the OpenAI Foundation board’s Safety and Security Committee, and procedures for resolving disagreements and coordinating publication timelines.
The company also outlined restrictions on conversations with employees. Discussions with OpenAI staff will remain off the record and cannot be published or attributed, although researchers can use a separate process to obtain company-attested statements for verification or clarification.
OpenAI said it will disclose potential conflicts of interest and apply cooling-off periods as part of the program’s independence safeguards.
The financial arrangements also differ across the four groups. Apollo Research and Goodfire will receive compensation that is not tied to the outcomes of their assessments, while METR and Transluce will not receive direct payments but may use credits to cover computing costs.
The first phase aims to give outside researchers deeper access to the development and testing of advanced AI systems, with OpenAI positioning independent evaluations as an additional layer of scrutiny beyond its internal safety processes.
Photo courtesy: Meir Chaimowitz / Shutterstock