A false intelligence report created with help from artificial intelligence nearly led the US military to intercept a Chinese ship in the Middle East , according to CNN . The report claimed the vessel was carrying parts linked to a nuclear weapons programme.
Misidentification by AI Nearly Triggered Military Action
Military officials were poised to execute an operation involving armed personnel ready to board a ship, with military aircraft already deployed, as reported by sources familiar with the incident. The operation was halted after officials reviewed the situation and discovered that an AI chatbot had incorrectly identified the ship’s cargo.
One source characterized the erroneous report as ‘entirely false’ and indicated that it ‘almost started a war.’
This incident highlights the growing role of artificial intelligence in military operations. In January, Defense Secretary Pete Hegseth unveiled the ‘Artificial Intelligence Acceleration Strategy,’ aimed at enhancing the integration of AI across various military functions, including operations and intelligence.
The US military moved toward intercepting the Chinese vessel, according to four sources. Two sources said armed military personnel were preparing to board it, while military aircraft were also in the air. CNN said it could not determine what the cargo actually was or whether the chatbot used by the analyst was a commercial system or a US government tool. Officials familiar with the systems said there is no single standard for checking information produced by AI.
A special operations command analyst used a chatbot to examine the intelligence. The AI system combined open-source information with secret signals intelligence held by the US government and reached the wrong conclusion about what the ship was carrying. The incident has raised concerns about the growing use of AI in military intelligence and targeting. Different parts of the US government are using different AI systems, with different rules and safety standards.
