Back
Technology

OpenAI and Microsoft Provide Funding for UK AI Security Institute's Alignment Project

Generated on: Last updated: 1 sources
View source

OpenAI and Microsoft Pledge New Funding to UK's AI Alignment Project

OpenAI and Microsoft have pledged new funding to the UK's AI Security Institute (AISI) flagship Alignment Project. This international initiative focuses on developing advanced AI systems that are safe, secure, and controllable.

Over £27 million is now available for AI alignment research, supporting approximately 60 projects. This significant investment includes £5.6 million from OpenAI and additional support from Microsoft. The funding was officially announced by UK Deputy Prime Minister David Lammy and AI Minister Kanishka Narayan at the AI Impact Summit in India on February 20.

The Alignment Project

The Alignment Project, initially announced last summer, is designed to ensure AI systems operate as intended, preventing unintentional or harmful behaviors as they become more capable. The first grants have already been awarded to 60 projects across eight countries, with a second round of funding scheduled for this summer.

What is AI Alignment?

AI alignment is the effort to guide advanced AI systems to consistently act according to human intentions, avoiding unforeseen or detrimental actions. This crucial field develops methods to mitigate unsafe behaviors as AI systems advance.

Progress in alignment is expected to enhance confidence and trust in AI, supporting the adoption of systems that aim to increase productivity, reduce medical scan times, and create new employment opportunities.

Challenges for global safety and governance could arise if there is a lack of continued progress in alignment research. Increasingly powerful AI models might behave in ways that are difficult to predict or manage, underscoring the urgency of this work.

Statements from Officials and Partners

UK Deputy Prime Minister David Lammy emphasized the importance of safety:

"AI offers us huge opportunities, but we will always be clear-eyed on the need to ensure safety is baked into it from the outset. We've built strong safety foundations which have put us in a position where we can start to realise the benefits of this technology. The support of OpenAI and Microsoft will be invaluable in continuing to progress this effort."

UK AI Minister Kanishka Narayan highlighted the link between trust and adoption:

"We can only unlock the full power of AI if people trust it - that's the mission driving all of us. Trust is one of the biggest barriers to AI adoption, and alignment research tackles this head-on. With fresh backing from OpenAI and Microsoft, we're supporting work that's crucial to ensuring AI delivers its huge benefits safely, confidently and for everyone."

Mia Glaese, VP of Research at OpenAI, reiterated the need for collaborative effort:

"As AI systems become more capable and more autonomous, alignment has to keep pace. The hardest problems won't be solved by any one organisation working in isolation-we need independent teams testing different assumptions and approaches. Our support for the UK AI Security Institute's Alignment Project complements our internal alignment work and helps strengthen a broader research ecosystem focused on keeping advanced systems reliable and controllable as they're deployed in more open-ended settings."

Supporting Organizations

In addition to OpenAI and Microsoft, the AISI's Alignment Project is supported by a broad international coalition that includes:

  • Canadian Institute for Advanced Research (CIFAR)
  • Australian Department of Industry, Science and Resources' AI Safety Institute
  • Schmidt Sciences
  • Amazon Web Services (AWS)
  • Anthropic
  • AI Safety Tactical Opportunities Fund
  • Halcyon Futures
  • Safe AI Fund
  • Sympatico Ventures
  • Renaissance Philanthropy
  • UK Research and Innovation (UKRI)
  • Advanced Research and Invention Agency (ARIA)

The project is further guided by an expert advisory board, including renowned figures like Yoshua Bengio, Zico Kolter, Shafi Goldwasser, and Andrea Lincoln.

Project Scope

The Alignment Project provides grant funding for research, access to compute infrastructure, and academic mentorship from AISI scientists to advance alignment research. The UK aims to lead global efforts in building trustworthy AI, supported by its AI companies, research institutions, and universities.