AI Safety Working Group

Mission

Support community development of AI safety tests and organize definition of research- and industry-standard AI safety benchmarks based on those tests.

Purpose

Our goal is for these benchmarks to:

1. Guide responsible development: Computing performance benchmarks such as MLPerf have repeatedly shown their ability to concretely define a common objective such as “faster” and thereby accelerate overall progress towards that objective. Similarly, the safety benchmarks can help define “safer” and thus accelerate the development of “safer” AI systems.
2. Support consumer/purchaser decision making: AI systems are complex and determining if an AI system is suitable for a particular use-case is challenging. The AI safety benchmarks should help individual consumers and corporate purchasers make more informed decisions.
3. Enable technically sound and risk-based policy regulation: Spurred by public concern, governments in the EU, UK, US, and elsewhere are increasingly examining the safety of AI systems. The safety benchmarks should enable data-driven decision making for informing regulations.

Deliverables

Specifically, the working group has the following four major tasks:

• Tests: Curate a pool of safety tests from diverse sources, including facilitating the development of better tests and testing methodologies.
• Benchmarks: Define benchmarks for specific AI use-cases, each of which uses a subset of the tests and summarizes the results in a way that enables decision making by non-experts.
• Platform: Develop a community platform for safety testing of AI systems that supports registration of tests, definition of benchmarks, testing of AI systems, management of test results, and viewing of benchmark scores.
• Governance: Define a set of principles and policies and initiate a broad multi-stakeholder process to ensure trustworthy decision making.

Meeting Schedule

Weekly on Friday from 8:35-9:30AM Pacific.

How to Join and Access Working Group Resources

• To sign up for the group mailing list and receive the meeting invite:
  1. Associate a Google account with your organizational email address.
  2. Request to join the AI Safety Google Group. Requests are manually reviewed, so please be patient.

Working Group Chairs

To contact all AI Safety working group chairs email ai-safety-chairs@mlcommons.org.