OECD Greendicators
Sustainability indicators for AI model cards – measuring environmental footprint of AI practices in a comprehensive approach
Challenge
AI Model Cards - a new concept to standardize environmental reporting for AI models
The challenge is to propose clearly defined sustainability indicators that could be included as part of a standardization drive for AI model cards, which can provide regulators with comparable benchmarks that measure sustainability practices of AI models across regulatory environments
About the prototype
While there is a growing industry trend to drive the standardization of information disclosure for accountability and transparency through AI model cards, current developments are limited to technical aspects and in most cases exclude sustainability metrics of AI practices. The OECD Greendicators offers a comprehensive set of benchmarks that should be included on AI model cards to comprehensively understand the sustainability impact of AI models encompassing the life cycle of AI practices from activities associated with model development, the infrastructural and energy frameworks facilitating AI practices, to ramifications beyond. In developing the prototype, the team investigated existing AI model cards, analyzed common sustainability indicators and their gaps, researched scientific literature and relevant sustainability reporting benchmarks, and holistically mapped four categories of sustainability indicators throughout AI life cycles. The prototype offers a set of measurable Key Performance Indicators (KPIs) that support policymakers in benchmarking sustainability practices of AI practices.
Outputs
Further information about the progress, milestones, and roadblocks.