
The Pentagon's guidelines for "responsible AI" aren't always followed, report shows
0 / 33
English
中文
Three of the Pentagon projects surveyed by GAO included weapons for counter-camouflage (upper image) and target recognition (lower images). Government Accountability Office/GAO hide caption The Pentagon is building weapons and projects with artificial intelligence capabilities that officials say don't always closely adhere to the agency's own guidelines for AI, according to a congressional watchdog report published in October.
(暂无翻译) (暂无翻译)
AI researchers and international organizations have long advocated for strict regulation of AI when used in weapons that could become unpredictable or function with little human control, arguing that those tools could endanger the lives of soldiers and civilians and risk quickly escalating wars.
(暂无翻译)
But Defense Secretary Pete Hegseth has repeatedly dismissed previous caution of AI tools and encouraged rapid autonomous innovation at the Pentagon. The Pentagon issued a memo in January saying the department would become "an 'AI-first' warfighting force across all components, from front to back."
(暂无翻译) (暂无翻译)
Last month, Hegseth announced a new warfare command focused on autonomous weapon development, including drones. Secretary of Defense Pete Hegseth arrives on stage for a discussion during an annual Army meeting on October 14, 2026 in Washington, DC.
(暂无翻译) (暂无翻译)
Kevin Dietsch/Getty Images North America hide caption The watchdog report, published by the U.S. Government Accountability Office on Oct. 14, grants a rare look inside how those kinds of projects are being developed.
(暂无翻译) (暂无翻译)
The GAO surveyed 10 officials involved with building 10 weapons and tools for the Pentagon that use AI to automatically identify targets on the battlefield, process surveillance and improve tactical decision making, and other tasks. The projects are among more than 300 being built with AI in the Pentagon.
(暂无翻译) (暂无翻译)
When responding to the GAO survey, six of the 10 officials said their teams had "identified risk(s)" with using the projects "in an operational environment." To address some of those sorts of risks, in 2021, the Pentagon sent a memo outlining six basic tenets to ensure that weapons built with AI are created responsibly.
(暂无翻译) (暂无翻译)
Those six guidelines mainly stress the importance of Pentagon-wide oversight, verification and "real-time monitoring" of the technology, and cooperation with allies "to advance global norms grounded in shared values."
(暂无翻译)
Alissa Czyz, who directed the GAO review, said the tenets evolved from earlier ethical principles, and while they weren't rules, they were understood to be important by people involved with building AI tools at the Pentagon. "It's a memo, right, at the end of the day, so it's not a department instruction," said Czyz.
(暂无翻译) (暂无翻译)
"It's something that the department has signaled that should be implemented."
(暂无翻译)
Most of the people involved with making the 10 weapons and projects reviewed by GAO had taken "at least initial steps" to follow the six tenets outlined in the memo, according to the report, and some of the projects were in early stages, Czyz clarified. But some of the responses indicated officials weren't always closely following the guidelines.
(暂无翻译) (暂无翻译)
Four officials told the GAO that requirements for the weapons and projects they were working on weren't "aligned with Responsible AI tenets."
(暂无翻译)
And three of the 10 officials told the GAO they "don't know" if the projects will be continuously monitored after they're deployed, though the six tenets encourage monitoring.
(暂无翻译)
Officials told the GAO that more access to expertise about the agency's guidelines or staff who know about them would increase their ability to incorporate AI responsibly. But the group that helps manage education on the Pentagon's guidelines, the Department of the Responsible AI Division, is understaffed.
(暂无翻译) (暂无翻译)
Although the group was authorized to hire 10 people in 2023, as of February, only three of those positions were filled and the Pentagon "is unlikely to fill vacant positions or increase staffing," the report states. "That's a very small number of folks tasked with a large responsibility of responsible AI throughout the department," said Czyz. The GAO issued two recommendations: The Pentagon should more clearly outline the responsibilities and meeting schedules of the office charged with overseeing AI regulation, and address understaffing.
(暂无翻译) (暂无翻译) (暂无翻译)
Although the Pentagon agreed with those recommendations, as of Oct. 22, the agency had not implemented those changes, a GAO representative confirmed to NPR.
(暂无翻译)
NPR asked the Pentagon when it planned to make those changes, but did not receive a response. When delivering a speech at SpaceX in January, Hegseth indicated he believed AI development at the Pentagon should not be slowed by those sorts of steps.
(暂无翻译) (暂无翻译)
"Our enterprise currently operates on staffing and committee cycles measured in months and years, and that's unacceptable," said Hegseth.
(暂无翻译)
"Military AI is going to be a race for the foreseeable future where the risks to U.S. national security of moving too slowly outweigh the impacts of imperfect alignment."
(暂无翻译)
NPR would like to hear from more people who work with federal agencies or AI companies and have information to share about how agencies are using AI. You can email the reporter of this article, Chiara Eisner, at ceisner@npr.org or contact her on Signal here, username ceis.78.
(暂无翻译) (暂无翻译)
仅供学习使用,如有侵权请联系删除 · 查看原文