“We call on world leaders to launch negotiations of a new legally binding instrument to set clear prohibitions and restrictions on autonomous weapon systems and to conclude such negotiations by 2026,” UN Secretary-General António Guterres and ICRC President Mirjana Spoljaric said on Thursday.
“In the current security landscape, setting clear international red lines will benefit all States,” they added, highlighting that “autonomous weapon systems – generally understood as weapon systems that select targets and apply force without human intervention – pose serious humanitarian, legal, ethical and security concerns.”
In addition, the two leaders said clear restrictions are needed for all other types of autonomous weapons, to ensure compliance with international law and ethical acceptability.
These include limiting where, when and for how long they are used, the types of targets they strike and the scale of force used, as well as ensuring the ability for effective human supervision, and timely intervention and deactivation.
Heightened concerns
The development and proliferation of the weapon systems have the potential to significantly change the way wars are fought and contribute to global instability and heightened international tensions.
By creating a perception of reduced risk to military forces and to civilians, they may lower the threshold for engaging in conflicts, inadvertently escalating violence.
“We must act now to preserve human control over the use of force. Human control must be retained in life and death decisions,” Mr. Guterres and Ms. Spoljaric said.
In their joint appeal, the UN and ICRC noted that the autonomous targeting of humans by machines is a moral line that should not be crossed, stressing that “machines with the power and discretion to take lives without human involvement should be prohibited by international law.”
“Our concerns have only been heightened by the increasing availability and accessibility of sophisticated new and emerging technologies, such as in robotics and Artificial Intelligence technologies, that could be integrated into autonomous weapons,” they said.
International humanitarian law
International law, particularly international humanitarian law, prohibits certain weapons and sets general restrictions on the use of all others.
States and individuals remain accountable for any violations. However, without a specific international agreement governing autonomous weapon systems, States can hold different views about how these general rules apply.
According to the organizations, new international rules on autonomous weapons are therefore needed to clarify and strengthen existing law. They will be a preventive measure, an opportunity to protect those that may be affected by such weapons and essential to avoiding terrible consequences for humanity.
“We urge Members States to take decisive action now to protect humanity,” Mr. Guterres and Ms. Spoljaric said.
Sounding the alarm
The very scientists and industry leaders responsible for such technological advances have also been sounding the alarm.
Mr. Guterres and Ms. Spoljaric said to harness new technologies for the good of humanity, world leaders must first address the most urgent risks and avoid irreparable consequences.
“This means prohibiting autonomous weapon systems which function in such a way that their effects cannot be predicted. For example, allowing autonomous weapons to be controlled by machine learning algorithms – fundamentally unpredictable software which writes itself – is an unacceptably dangerous proposition.”
Prohibitions and restrictions
In addition, they said clear restrictions are needed for all other types of autonomous weapons, to ensure compliance with international law and ethical acceptability.
These include limiting where, when and for how long they are used, the types of targets they strike and the scale of force used, as well as ensuring the ability for effective human supervision, and timely intervention and deactivation.
They went on to say that “despite the increasing reports of testing and use of various types of autonomous weapon systems, it is not too late to take action.”
After more than a decade of discussions within the UN, including in the Human Rights Council, under the Convention on Certain Conventional Weapons and at the General Assembly, the foundation has been laid for the adoption of explicit prohibitions and restrictions.
“Now, States must build on this groundwork, and come together constructively to negotiate new rules that address the tangible threats posed by these weapon technologies,” Mr. Guterres and Ms. Spoljaric concluded.