Demonstrators in Berlin take part in a "Stop Killer Robots" campaign organized by German NGO "Facing Finance" to ban what they call killer robots, in March 2019 Photo: dpa/AFP/File
tech

Amazon, Microsoft, 'putting world at risk of killer AI': study

8 Comments
By Issam AHMED

Amazon, Microsoft and Intel are among leading tech companies putting the world at risk through killer robot development, according to a report that surveyed major players from the sector about their stance on lethal autonomous weapons.

Dutch NGO Pax ranked 50 companies by three criteria: whether they were developing technology that could be relevant to deadly AI, whether they were working on related military projects, and if they had committed to abstaining from contributing in the future.

"Why are companies like Microsoft and Amazon not denying that they're currently developing these highly controversial weapons, which could decide to kill people without direct human involvement?" said Frank Slijper, lead author of the report published this week.

The use of AI to allow weapon systems to autonomously select and attack targets has sparked ethical debates in recent years, with critics warning they would jeopardize international security and herald a third revolution in warfare after gunpowder and the atomic bomb.

A panel of government experts debated policy options regarding lethal autonomous weapons at a meeting of the United Nations Convention on Certain Conventional Weapons in Geneva on Wednesday.

Google, which last year published guiding principles eschewing AI for use in weapons systems, was among seven companies found to be engaging in "best practice" in the analysis that spanned 12 countries, as was Japan's SoftBank, best known for its humanoid Pepper robot.

Twenty-two companies were of "medium concern," while 21 fell into a "high concern" category, notably Amazon and Microsoft who are both bidding for a $10 billion Pentagon contract to provide the cloud infrastructure for the U.S. military.

Others in the "high concern" group include Palantir, a company with roots in a CIA-backed venture capital organization that was awarded an $800 million contract to develop an AI system "that can help soldiers analyze a combat zone in real time."

"Autonomous weapons will inevitably become scalable weapons of mass destruction, because if the human is not in the loop, then a single person can launch a million weapons or a hundred million weapons," Stuart Russell, a computer science professor at the University of California, Berkeley told AFP on Wednesday.

"The fact is that autonomous weapons are going to be developed by corporations, and in terms of a campaign to prevent autonomous weapons from becoming widespread, they can play a very big role," he added.

The development of AI for military purposes has triggered debates and protest within the industry: last year Google declined to renew a Pentagon contract called Project Maven, which used machine learning to distinguish people and objects in drone videos.

It also dropped out of the running for Joint Enterprise Defense Infrastructure (JEDI), the cloud contract that Amazon and Microsoft are hoping to bag.

The report noted that Microsoft employees had also voiced their opposition to a U.S. Army contract for an augmented reality headset, HoloLens, that aims at "increasing lethality" on the battlefield.

According to Russell, "anything that's currently a weapon, people are working on autonomous versions, whether it's tanks, fighter aircraft, or submarines."

Israel's Harpy is an autonomous drone that already exists, "loitering" in a target area and selecting sites to hit.

More worrying still are new categories of autonomous weapons that don't yet exist -- these could include armed mini-drones like those featured in the 2017 short film "Slaughterbots."

"With that type of weapon, you could send a million of them in a container or cargo aircraft -- so they have destructive capacity of a nuclear bomb but leave all the buildings behind," said Russell.

Using facial recognition technology, the drones could "wipe out one ethnic group or one gender, or using social media information you could wipe out all people with a political view."

The European Union in April published guidelines for how companies and governments should develop AI, including the need for human oversight, working towards societal and environmental wellbeing in a non-discriminatory way, and respecting privacy.

Russell argued it was essential to take the next step in the form of an international ban on lethal AI, that could be summarized as "machines that can decide to kill humans shall not be developed, deployed, or used."

© 2019 AFP

©2019 GPlusMedia Inc.

8 Comments
Login to comment

From Deus Ex to Terminator, to even Horizon Zero Dawn, it's crazy how many times these screenwriters were able to predict, in a way, aspects of our future.

4 ( +4 / -0 )

Johnny 5 is alive!

1 ( +1 / -0 )

Governments are probably looking at the bottom line and AI Robot Soldiers are cheaper in the long run.

2 ( +2 / -0 )

More military development at the directions of Washington/White House. US starting and continuing anther arms race. When will the people wake up? Maybe when its too late.

0 ( +1 / -1 )

Tawkeeo: From Deus Ex to Terminator, to even Horizon Zero Dawn, it's crazy how many times these screenwriters were able to predict, in a way, aspects of our future.

"I Never Asked For This"

--Adam Jensen

1 ( +1 / -0 )

Lets see.. 8 billion people in the world and very soon rates of unemployment will sky rocket because companies are developing technology to do away with mundane manual tasks... the justification is that people can do more value added things... sounds good so far... then think about what these people are really going to do... how will they be able to afford food, clothes, housing, etc. it’s a headwind coming at us very soon and we need to be thinking ahead. spending billions developing Ai based military equipment is only one of the problems we are facing...

As George Carlin eloquently puts it: https://youtu.be/7W33HRc1A6c

1 ( +1 / -0 )

Ha. Humans need food air to survive. AI needs electric. No electric no threat.

0 ( +0 / -0 )

Ama Soft ... not.... Ama Coming for you.

Oh Should I copyright that one ?

0 ( +0 / -0 )

Login to leave a comment

Facebook users

Use your Facebook account to login or register with JapanToday. By doing so, you will also receive an email inviting you to receive our news alerts.

Facebook Connect

Login with your JapanToday account

User registration

Articles, Offers & Useful Resources

A mix of what's trending on our other sites