OpenAI Faces Internal Discord Over Pentagon Deal, Raising Ethical Concerns About AI in Warfare
WASHINGTON (AP) – OpenAI, the creator of ChatGPT, is grappling with internal fallout following its recent agreement with the U.S. Department of Defense, a deal that has ignited a debate over the ethical implications of artificial intelligence in military applications and domestic surveillance. The company secured the contract last month, stepping in after Anthropic declined to unconditionally allow military use of its AI technology.
The controversy deepened Saturday with the resignation of Caitlin Kalinowski, OpenAI’s top robotics executive. Kalinowski publicly stated her departure stemmed from concerns over the speed with which the Pentagon deal was finalized and the potential for unchecked surveillance and autonomous weapons systems.
“Surveillance of Americans without judicial oversight and lethal autonomy without human authorization are lines that deserved more deliberation than they got,” Kalinowski wrote in a post on X, formerly known as Twitter. She emphasized the issue was “about principle, not people,” and highlighted a “governance concern” regarding the rushed nature of the agreement.
OpenAI CEO Sam Altman responded to the criticism, announcing via X that the company would modify the contract to prevent its models from being used for “domestic surveillance of US persons and nationals.” However, this assurance has done little to quell concerns among some experts and within the company itself.
The Pentagon’s pursuit of OpenAI came after Anthropic refused to agree to terms allowing for unrestricted military application of its Claude AI models, a decision that reportedly drew criticism from U.S. officials. The situation underscores a growing tension between AI developers and governments eager to leverage the technology for national security purposes.
The deal with OpenAI, while securing a defense contract, has prompted questions about the safeguards in place to prevent misuse of the powerful AI technology. The speed of the agreement, as highlighted by Kalinowski, raises concerns about adequate oversight and the potential for unintended consequences.
Kalinowski’s prior experience developing augmented reality glasses at Meta adds another layer to the narrative, suggesting a background steeped in the complexities of rapidly evolving technology and its societal impact.
This development arrives as the competition between OpenAI and Anthropic intensifies, with both companies vying for dominance in the rapidly expanding AI landscape. The Pentagon’s shift from considering Anthropic to OpenAI highlights the strategic importance of these technologies and the willingness of governments to prioritize access, even amidst ethical concerns.
(France 24 with AFP)
