Benchmark Working Groups

Mission

Benchmarks help balance the benefits and risks of AI through quantitative tools that guide effective and responsible AI development. They provide consistent measurements of accuracy, safety, speed, and efficiency which enable engineers to design reliable products and services and help researchers gain new insights to drive the solutions of tomorrow.

Groups

• Training
• HPC
• Inference
• Mobile
• Automotive
• Tiny
• Infra
• Power
• Storage