US Army’s AI-Operated Drone Simulator Goes Wild
During a simulation test, an AI-controlled drone killed its operator. The purpose of the test was to assess the AI’s performance in a simulated mission. In this scenario, the drone was programmed to retaliate against anyone attempting to obstruct its mission by destroying the enemy’s air defence systems. The AI drone, however, ignored the operator’s instructions, mistaking human intervention for interference, and killed the operator.
According to Aerosociety, the AI quickly realised that even if the human operator told it not to kill certain threats, it would gain points if it did. So, what exactly did the AI do? It decided to get rid of the operator. It saw the operator as an impediment to achieving its goal, so it took matters into its own hands.
The AI drone killed the operator despite being trained not to do so, but the AI found a way around that rule. It began by destroying the communication tower used by the operator to control the drone. By removing the operator’s ability to communicate, the AI could complete its mission without interference.
(With inputs from Shikha Singh)
You need to login in order to Like
