AI Accountability Policy Report (NTIA, U.S. Commerce Dept.)

Abstract

This report was authored for and issued by the U.S. Commerce Department's National Telecommunications and Information Administration. It calls for improved transparency into AI systems, independent evaluations to verify the claims made about these systems, and consequences for imposing unacceptable risks or making unfounded claims. It makes eight sets of policy recommendations for the U.S. government:

Guidance for 1. AI audits and auditors; 2. AI system and model disclosure; and 3. AI liability standards.

Support for 4. people and tools, including establishing and funding a National AI Research Resource; and 5. research, including into AI system capability and limitation assessments and performance evaluations.

Regulations governing 6. required AI audits and other independent evaluations of high-risk AI model classes and systems; 7. strengthened government capacity across sectors, including maintaining registries of high-risk AI deployments, AI adverse incidents, and AI system audits; and 8. federal contracting to ensure that government suppliers, contractors, and grantees adopt sound AI governance and assurance practices.

Keywords: AI, AI accountability, algorithmic decision systems, transparency, AI audits, AI evaluations, regulation