Robot ethics

Ethical problems related to robots
(Learn how and when to remove this template message)

Robot ethics, sometimes known as "roboethics", concerns ethical problems that occur with robots, such as whether robots pose a threat to humans in the long or short run, whether some uses of robots are problematic (such as in healthcare or as 'killer robots 22' in war), and how robots should be designed such that they act 'ethically' (this last concern is also called machine ethics). Alternatively, roboethics refers specifically to the ethics of human behavior towards robots, as robots become increasingly advanced.[1] Robot ethics is a sub-field of ethics of technology, specifically information technology, and it has close links to legal as well as socio-economic concerns. Researchers from diverse areas are beginning to tackle ethical questions about creating robotic technology and implementing it in societies, in a way that will still ensure the safety of the human race.[2]

While the issues are as old as the word robot, serious academic discussions started around the year 2000. Robot ethics requires the combined commitment of experts of several disciplines, who have to adjust laws and regulations to the problems resulting from the scientific and technological achievements in Robotics and AI. The main fields involved in robot ethics are: robotics, computer science, artificial intelligence, philosophy, ethics, theology, biology, physiology, cognitive science, neurosciences, law, sociology, psychology, and industrial design.[3]

History and events

Laws of robotics
Three Laws of Robotics
by Isaac Asimov
(in culture)
Related topics
  • v
  • t
  • e

Some of the central discussion of ethics in relation to the treatment of non-human or non-biological things and their potential "spirituality". Another central topic, has to do with the development of machinery and eventually robots, this philosophy was also applied to robotics. One of the first publications directly addressing and setting the foundation for robot ethics was Runaround (story), a science fiction short story written by Isaac Asimov in 1942 which featured his well known Three Laws of Robotics. These three laws were continuously altered by Asimov, and a fourth, or zeroth law, was eventually added to precede the first three, in the context of his science fiction works. The short term "roboethics" was most likely coined by Gianmarco Veruggio.[4]

An important event that propelled the concern of roboethics was the First International Symposium on Roboethics in 2004 by the collaborative effort of Scuola di Robotica, the Arts Lab of Scuola Superiore Sant'Anna, Pisa, and the Theological Institute of Pontificia Accademia della Santa Croce, Rome.[5] Due to the activities of the school of Robotics which is a non profit organization and is to promote the knowledge of the science of Robotics among students, and the general public, this Roboethics Symposium was made. In discussions with students and non specialists, Gianmarco Veruggio and Fiorella Operto thought that it was necessary to spread correct conceptions among the general public about the alleged dangers in Robotics. They thought that a productive debate based on accurate insights and real knowledge could push people to take an active part in the education of public opinion, make them comprehend the positive uses of the new technology, and prevent its abuse. After two days of intense debating, anthropologist Daniela Cerqui identified three main ethical positions emerging from two days of intense debate:

  1. Those who are not interested in ethics. They consider that their actions are strictly technical, and do not think they have a social or a moral responsibility in their work.
  2. Those who are interested in short-term ethical questions. According to this profile, questions are expressed in terms of “good” or “bad,” and refer to some cultural values. For instance, they feel that robots have to adhere to social conventions. This will include “respecting” and helping humans in diverse areas such as implementing laws or in helping elderly people. (Such considerations are important, but we have to remember that the values used to define the “bad” and the “good” are relative. They are the contemporary values of the industrialized countries).
  3. Those who think in terms of long-term ethical questions, about, for example, the “Digital divide” between South and North, or young and elderly. They are aware of the gap between industrialized and poor countries, and wonder whether the former should not change their way of developing robotics to be more useful to the South. They do not formulate explicitly the question what for, but we can consider that it is implicit".[6]

These are some important events and projects in robot ethics. Further events in the field are announced by the euRobotics ELS topics group, and by RoboHub:

Computer scientist Virginia Dignum noted in a March 2018 issue of Ethics and Information Technology that the general societal attitude toward artificial intelligence (AI) has, in the modern era, shifted away from viewing AI as a tool and toward viewing it as an intelligent “team-mate”. In the same article, she assessed that, with respect to AI, ethical thinkers have three goals, each of which she argues can be achieved in the modern era with careful thought and implementation.[12][13][14][15][16] The three ethical goals are as follows:

In popular culture

Roboethics as a science or philosophical topic has begun to be a common theme in science fiction literature and films. One film that could be argued to be ingrained in pop culture that depicts the dystopian future use of robotic AI is The Matrix, depicting a future where humans and conscious sentient AI struggle for control of planet earth resulting in the destruction of most of the human race. An animated film based on The Matrix, the Animatrix, focused heavily on the potential ethical issues and insecurities between humans and robots. The movie is broken into short stories. Animatrix's animated shorts are also named after Isaac Asimov's fictional stories.

Another facet of roboethics is specifically concerned with the treatment of robots by humans, and has been explored in numerous films and television shows. One such example is Star Trek: The Next Generation, which has a humanoid android, named Data, as one of its main characters. For the most part, he is trusted with mission critical work, but his ability to fit in with the other living beings is often in question.[18] More recently, the movie Ex Machina and TV show Westworld have taken on these ethical questions quite directly by depicting hyper-realistic robots that humans treat as inconsequential commodities.[19][20] The questions surrounding the treatment of engineered beings has also been key component of Blade Runner (franchise) for over 50 years.[21] Films like Her have even distilled the human relationship with robots even further by removing the physical aspect and focusing on emotions.

Although not a part of roboethics per se, the ethical behavior of robots themselves has also been a joining issue in roboethics in popular culture. The Terminator series focuses on robots run by an conscious AI program with no restraint on the termination of its enemies. This series too has the same archetype as The Matrix series, where robots have taken control. Another famous pop culture case of robots or AI without programmed ethics or morals is HAL 9000 in the Space Odyssey series, where HAL (a computer with advanced AI capabilities who monitors and assists humans on a space station) kills all the humans on board to ensure the success of the assigned mission after his own life is threatened.[22]

Killer robots

A soldier operates the remote controlled Mark 8 Wheel Barrow Counter IED Robot. The soldier is part of the EOD (Explosive Ordinance Device) and Search team based out of FOB (Forward Operating Base) Ouellette. Courtesy of the UK Ministry of Defense.

Lethal Autonomous Weapon Systems (LAWS) which is often called “killer robots,” are theoretically able to target and fire without human supervision and interference. In 2014, the Convention on Conventional Weapons (CCW) held two meetings. The first was the Meeting of Experts on Lethal Autonomous Weapons Systems (LAWS). This meeting was about the special mandate on LAWS and intrigued intense discussion.[23] National delegations and many non-governmental organizations(NGOs) expressed their opinions on the matter.

Numerous NGOs and certain states such as Pakistan and Cuba are calling for a preventive prohibition of LAWS. They proposed their opinions based on deontological and consequentialist reasoning. On the deontological side, certain philosophers such as Peter Asaro and Robert Sparrow, most NGOs, and the Vatican all argue that authorizing too much rights to machine violates human dignity, and that people have the “right not to be killed by a machine.” To support their standpoint, they repeatedly cite the Martens Clause.

In the end of this meeting, the most important consequentialist objection was that LAWS would never be able to respect international humanitarian law (IHL), as believed by NGOs, many researchers, and several states (Pakistan, Austria, Egypt, Mexico).

According to the International Committee of the Red Cross(ICRC), “there is no doubt that the development and use of autonomous weapon systems in armed conflict is governed by international humanitarian law.”[24] States recognize this: those who participated in the first UN Expert Meeting in May 2014 recognized respect for IHL as an essential condition for the implementation of LAWS. With diverse predictions, certain states believe LAWS will be unable to meet this criterion, while others underline the difficulty of adjudicating at this stage without knowing the weapons’ future capabilities (Japan, Australia). All insist equally on the ex-ante verification of the systems’ conformity to IHL before they are put into service, in virtue of article of the first additional protocol to the Geneva Conventions.

Sex robots

In 2015, the Campaign Against Sex Robots (CASR) was launched to draw attention to the sexual relationship of humans with machines. The campaign claims that sex robots are potentially harmful and will contribute to inequalities in society, and that an organized approach and ethical response against the development of sex robots is necessary.[25]

In the article Should We Campaign Against Sex Robots?, published by the MIT Press, researchers pointed some flaws on this campaign and did not support a ban on sex robots completely. Firstly, they argued that the particular claims advanced by the CASR were "unpersuasive," partly because of a lack of clarity about the campaign’s aims and partly because of substantive defects in the main ethical objections put forward by campaign’s founders. Secondly, they argued that it would be very difficult to endorse a general campaign against sex robots unless one embraced a highly conservative attitude towards the ethics of sex. Drawing upon the example of the campaign to stop killer robots, they thought that there were no inherently bad properties of sex robots that give rise to similarly serious levels of concern, the harm caused by sex robots being speculative and indirect. Nonetheless, the article concedes that there are legitimate concerns that can be raised about the development of sex robots.[26]


With contemporary technological issues emerging as society pushes on, one topic that requires thorough thought is robot ethics concerning the law. Academics have been debating the process of how a government could go about creating legislation with robot ethics and law. A pair of scholars that have been asking these questions are Neil M. Richards Professor of Law at Washington University in St. Louis as well as, William D. Smart Associate Professor of Computer Science at Washington University in St. Louis. In their paper "How Should Robots Think About Law" they make four main claims concerning robot ethics and law.[27] The groundwork of their argument lays on the definition of robot as "non-biological autonomous agents that we think captures the essence of the regulatory and technological challenges that robots present, and which could usefully be the basis of regulation." Second, the pair explores the future advanced capacities of robots within around a decades time. Their third claim argues a relation between the legal issues robot ethics and law experiences with the legal experiences of cyber-law. Meaning that robot ethics laws can look towards cyber-law for guidance. The "lesson" learned from cyber-law being the importance of the metaphors we understand emerging issues in technology as. This is based on if we get the metaphor wrong for example, the legislation surrounding the emerging technological issue is most likely wrong. The fourth claim they argue against is a metaphor that the pair defines as "The Android Fallacy". They argue against the android fallacy which claims humans and non-biological entities are "just like people".

Empirical research

There is mixed evidence as to whether people judge robot behavior similarly to humans or not. Some evidence indicates that people view bad behavior negatively and good behavior positively regardless of whether the agent of the behavior is a human or a robot; however, robots receive less credit for good behavior and more blame for bad behavior.[28] Other evidence suggests that malevolent behavior by robots is seen as more morally wrong than benevolent behavior is seen as morally right; malevolent robot behavior is seen as more intentional than benevolent behavior.[29] In general, people's moral judgments of both robots and humans are based on the same justifications and concepts but people have different moral expectations when judging humans and robots.[30] Research has also found that when people try to interpret and understand how robots decide to behave in a particular way, they may see robots as using rules of thumb (advance the self, do what is right, advance others, do what is logical, and do what is normal) that align with established ethical doctrines (egotism, deontology, altruism, utilitarianism, and normative).[31]

See also


  1. ^ Veruggio, Gianmarco; Operto, Fiorella (2008), Siciliano, Bruno; Khatib, Oussama (eds.), "Roboethics: Social and Ethical Implications of Robotics", Springer Handbook of Robotics, Springer Berlin Heidelberg, pp. 1499–1524, doi:10.1007/978-3-540-30301-5_65, ISBN 9783540303015
  2. ^ "Robot Ethics". IEEE Robotics and Automation Society. Retrieved 2017-06-26.
  3. ^ "Robot Ethics - IEEE Robotics and Automation Society - IEEE Robotics and Automation Society". Retrieved 2022-04-10.
  4. ^ Tzafestas, Spyros G. (2016). Roboethics A Navigating Overview. Cham: Springer. p. 1. ISBN 978-3-319-21713-0.
  5. ^ "ROBOETHICS Cover". Retrieved 2020-09-29.
  6. ^ Veruggio, Gianmarco. "The Birth of Roboethics" (PDF).
  7. ^ "Saudi Arabia gives citizenship to a non-Muslim, English-Speaking robot". Newsweek. 26 October 2017.
  8. ^ "Saudi Arabia bestows citizenship on a robot named Sophia". TechCrunch. October 26, 2017. Retrieved October 27, 2016.
  9. ^ "Saudi Arabia takes terrifying step to the future by granting a robot citizenship". AV Club. October 26, 2017. Retrieved October 28, 2017.
  10. ^ "Saudi Arabia criticized for giving female robot citizenship, while it restricts women's rights - ABC News". Retrieved 2017-10-28.
  11. ^ "Non-Human Party". 2021.
  12. ^ Rahwan, Iyad (2018). "Society-In-the-Loop: Programming the Algorithmic Social Contract". Ethics and Information Technology. 20: 5–14. arXiv:1707.07232. doi:10.1007/s10676-017-9430-8. S2CID 3674879.
  13. ^ Bryson, Joanna (2018). "Patiency Is Not a Virtue: the Design of Intelligent Systems and Systems of Ethics". Ethics and Information Technology. 20: 15–26. doi:10.1007/s10676-018-9448-6.
  14. ^ Vamplew, Peter; Dazeley, Richard; Foale, Cameron; Firmin, Sally (2018). "Human-Aligned Artificial Intelligence Is a Multiobjective Problem". Ethics and Information Technology. 20: 27–40. doi:10.1007/s10676-017-9440-6. hdl:1959.17/164225. S2CID 3696067.
  15. ^ Bonnemains, Vincent; Saurel, Claire; Tessier, Catherine (2018). "Embedded Ethics: Some Technical and Ethical Challenges" (PDF). Ethics and Information Technology. 20: 41–58. doi:10.1007/s10676-018-9444-x. S2CID 3697093.
  16. ^ Arnold, Thomas; Scheutz, Matthias (2018). "The 'Big Red Button' Is Too Late: An Alternative Model for the Ethical Evaluation of AI Systems". Ethics and Information Technology. 20: 59–69. doi:10.1007/s10676-018-9447-7. S2CID 3582967.
  17. ^ Dignum, Virginia (2018). "Ethics in Artificial Intelligence: Introduction to the Special Issue". Ethics and Information Technology. 20: 1–3. doi:10.1007/s10676-018-9450-z.
  18. ^ Short, Sue (2003-01-01). "The Measure of a Man?: Asimov's Bicentennial Man, Star Trek's Data, and Being Human". Extrapolation. 44 (2): 209–223. doi:10.3828/extr.2003.44.2.6. ISSN 0014-5483.
  19. ^ Staff, Pacific Standard. "Can 'Westworld' Give Us New Ways of Talking About Slavery?". Pacific Standard. Retrieved 2019-09-16.
  20. ^ Parker, Laura (2015-04-15). "How 'Ex Machina' Stands Out for Not Fearing Artificial Intelligence". The Atlantic. Retrieved 2019-09-16.
  21. ^ Kilkenny, Katie. "The Meaning of Life in 'Blade Runner 2049'". Pacific Standard. Retrieved 2019-09-16.
  22. ^ Krishnan, Armin (2016). Killer Robots: Legality and Ethicality of Autonomous Weapons. Routledge. doi:10.4324/9781315591070. ISBN 9781315591070. Retrieved 2019-09-16.
  23. ^ "2014". Retrieved 2022-04-03.
  24. ^ "International Committee of the Red Cross (ICRC) position on autonomous weapon systems: ICRC position and background paper". International Review of the Red Cross. 102 (915): 1335–1349. December 2020. doi:10.1017/s1816383121000564. ISSN 1816-3831. S2CID 244396800.
  25. ^ Temperton, James (2015-09-15). "Campaign calls for ban on sex robots". Wired UK. ISSN 1357-0978. Retrieved 2022-08-07.
  26. ^ Danaher, John; Earp, Brian D.; Sandberg, Anders (2017), Danaher, John; McArthur, Neil (eds.), "Should We Campaign Against Sex Robots?", Robot Sex: Social and Ethical Implications, Cambridge, MA: MIT Press, retrieved 2022-04-16
  27. ^ Richards, Neil M.; Smart, William D. (2013). "How Should the Law Think About Robots?". SSRN 2263363.
  28. ^ Banks, Jaime (2020-09-10). "Good Robots, Bad Robots: Morally Valenced Behavior Effects on Perceived Mind, Morality, and Trust". International Journal of Social Robotics. 13 (8): 2021–2038. doi:10.1007/s12369-020-00692-3.
  29. ^ Swiderska, Aleksandra; Küster, Dennis (2020). "Robots as Malevolent Moral Agents: Harmful Behavior Results in Dehumanization, Not Anthropomorphism". Cognitive Science. 44 (7): e12872. doi:10.1111/cogs.12872. PMID 33020966. S2CID 220429245.
  30. ^ Voiklis, John; Kim, Boyoung; Cusimano, Corey; Malle, Bertram F. (August 2016). "Moral judgments of human vs. robot agents". 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN): 775–780. doi:10.1109/ROMAN.2016.7745207. ISBN 978-1-5090-3929-6. S2CID 25295130.
  31. ^ Banks, Jaime; Koban, Kevin (2021). "Framing Effects on Judgments of Social Robots' (Im)Moral Behaviors". Frontiers in Robotics and AI. 8: 627233. doi:10.3389/frobt.2021.627233. PMC 8141842. PMID 34041272.


Further reading

External links

  • v
  • t
  • e
Main articles
Shadow Hand Bulb large.jpg
  • v
  • t
  • e