US AI Safety Institute partners with Anthropic and OpenAI to enhance AI safety standards

The U.S. Artificial Intelligence Safety Institute (AISI), a key entity within the U.S. Department of Commerce’s National Institute of Standards and Technology (NIST), has entered into significant agreements with leading AI firms Anthropic and OpenAI. These groundbreaking partnerships are set to enhance the development of safe and trustworthy AI technologies.

Table of Contents

Framework for Collaborative AI Safety Research

Through Memoranda of Understanding (MoUs) with each company, the U.S. AI Safety Institute will gain early access to new AI models developed by Anthropic and OpenAI, both before and after their public launch. This collaboration will enable focused research on evaluating these models’ capabilities, identifying potential safety risks, and developing effective strategies to mitigate those risks.

Key Benefits of Collaborative Research

Early access to cutting-edge AI models from leading developers
Opportunities for collaborative research and evaluation of AI safety risks
Development of effective mitigation strategies for identified risks

Advancing the Science of AI Safety

Elizabeth Kelly, director of the U.S. AI Safety Institute, emphasized the importance of these agreements:

"Safety is essential to fueling breakthrough technological innovation. With these agreements in place, we look forward to beginning our technical collaborations with Anthropic and OpenAI to advance the science of AI safety. These agreements are just the start, but they are an important milestone as we work to help responsibly steward the future of AI."

Global Collaboration for AI Safety

The U.S. AI Safety Institute will also work closely with the U.K. AI Safety Institute to provide comprehensive feedback on improving the safety of AI models developed by Anthropic and OpenAI. This international partnership highlights the global importance of ensuring that AI technologies are developed and deployed safely.

International Collaboration

The U.S. AI Safety Institute will collaborate with the U.K. AI Safety Institute
Comprehensive feedback on improving AI model safety will be provided
Global standards for AI safety will be promoted

NIST’s Legacy in Science and Technology

Building on NIST’s extensive history in advancing measurement science, technology, and standards, the U.S. AI Safety Institute will use these agreements to further its work in AI. The research and evaluations conducted under these partnerships will contribute to a deeper understanding of advanced AI systems and the various risks they present.

NIST’s Contributions

NIST has a rich history in advancing measurement science, technology, and standards
The U.S. AI Safety Institute will leverage this expertise in its work on AI safety
Research and evaluations conducted under these partnerships will contribute to a deeper understanding of advanced AI systems

Supporting U.S. AI Policy

These agreements align with the Biden-Harris administration’s initiatives on AI, including the recent Executive Order on AI. They also support the voluntary commitments made by leading AI developers to ensure that AI technologies are developed and used in a safe, secure, and trustworthy manner.

Aligning with U.S. AI Policy

The agreements align with the Biden-Harris administration’s initiatives on AI
The collaboration between the U.S. AI Safety Institute, Anthropic, and OpenAI supports voluntary commitments made by leading AI developers

Conclusion

The partnerships between the U.S. AI Safety Institute, Anthropic, and OpenAI will play a crucial role in advancing AI safety research and promoting responsible development of AI technologies.

Conclusion