Limitations and risks of machine ethics

Many authors have proposed constraining the behaviour of intelligent systems with 'machine ethics' to ensure positive social outcomes from the development of such systems. This paper critically analyses the prospects for machine ethics, identifying several inherent limitations. While machi...

Full description

Saved in:
Bibliographic Details
Published inJournal of experimental & theoretical artificial intelligence Vol. 26; no. 3; pp. 355 - 372
Main Author Brundage, Miles
Format Journal Article
LanguageEnglish
Published Abingdon Taylor & Francis 03.07.2014
Taylor & Francis Ltd
Subjects
Agents (artificial intelligence)
artificial general intelligence
Artificial intelligence
Complexity
Computation
Constraining
Ethics
Expert systems
Intelligent systems
machine ethics
Risk
Online AccessGet full text
ISSN0952-813X
1362-3079
DOI10.1080/0952813X.2014.895108

Cover

Abstract Many authors have proposed constraining the behaviour of intelligent systems with 'machine ethics' to ensure positive social outcomes from the development of such systems. This paper critically analyses the prospects for machine ethics, identifying several inherent limitations. While machine ethics may increase the probability of ethical behaviour in some situations, it cannot guarantee it due to the nature of ethics, the computational limitations of computational agents and the complexity of the world. In addition, machine ethics, even if it were to be 'solved' at a technical level, would be insufficient to ensure positive social outcomes from intelligent systems.
AbstractList Many authors have proposed constraining the behaviour of intelligent systems with 'machine ethics' to ensure positive social outcomes from the development of such systems. This paper critically analyses the prospects for machine ethics, identifying several inherent limitations. While machine ethics may increase the probability of ethical behaviour in some situations, it cannot guarantee it due to the nature of ethics, the computational limitations of computational agents and the complexity of the world. In addition, machine ethics, even if it were to be 'solved' at a technical level, would be insufficient to ensure positive social outcomes from intelligent systems.
Author Brundage, Miles
Author_xml – sequence: 1
  givenname: Miles
  surname: Brundage
  fullname: Brundage, Miles
  email: miles.brundage@asu.edu
  organization: Consortium for Science, Policy, and Outcomes, Arizona State University
BookMark eNqFkE1LAzEQhoNUsK3-Aw8LHvSydbJJdhMvIsUvKHhR8BbSJEtTd5OabJH-e7esXnrQ08DwPC8z7wSNfPAWoXMMMwwcrkGwgmPyPisA0xkXrN8eoTEmZZETqMQIjfdIvmdO0CSlNQBghvEYXS5c6zrVueBTprzJoksfKQt11iq9ct5mtls5nU7Rca2aZM9-5hS9Pdy_zp_yxcvj8_xukWtKeJdTA0tqsCprYZQRwEvgTIMuS2sY09gWpaH10gpGCROacl5hqhRWQHqxMmSKrobcTQyfW5s62bqkbdMob8M2ScyYKKkAKHr04gBdh230_XU9RUlVVQN1M1A6hpSiraX--beLyjUSg9x3KH87lPsO5dBhL9MDeRNdq-LuP-120JyvQ2zVV4iNkZ3aNSHWUXntkiR_JnwD9LiH1w
CitedBy_id crossref_primary_10_1007_s00146_020_01132_6
crossref_primary_10_1007_s11023_017_9448_z
crossref_primary_10_1145_3419633
crossref_primary_10_1145_3599974
crossref_primary_10_5465_amr_2022_0237
crossref_primary_10_1007_s13347_020_00392_w
crossref_primary_10_1007_s00146_023_01697_y
crossref_primary_10_1007_s10676_021_09587_x
crossref_primary_10_1080_0952813X_2016_1186228
crossref_primary_10_1007_s00146_020_01010_1
crossref_primary_10_1080_0952813X_2021_1964003
crossref_primary_10_1145_3603371
crossref_primary_10_1007_s00146_021_01283_0
crossref_primary_10_1007_s00146_022_01601_0
crossref_primary_10_1142_S0218213024600017
crossref_primary_10_3389_frai_2020_00034
crossref_primary_10_1007_s11023_021_09556_9
crossref_primary_10_1109_JPROC_2018_2865996
crossref_primary_10_1007_s10462_024_10732_3
crossref_primary_10_1007_s11098_024_02176_w
crossref_primary_10_1088_1742_6596_1399_3_033050
crossref_primary_10_1109_ACCESS_2020_2991403
crossref_primary_10_35377_saucis___1441194
crossref_primary_10_1080_0952813X_2014_895110
crossref_primary_10_1007_s00146_021_01228_7
crossref_primary_10_1007_s40926_020_00130_4
crossref_primary_10_1007_s44230_023_00036_0
crossref_primary_10_1016_j_cosrev_2021_100452
crossref_primary_10_1007_s10676_017_9440_6
crossref_primary_10_1007_s11948_019_00151_x
crossref_primary_10_1007_s10676_024_09755_9
crossref_primary_10_1007_s00146_020_01089_6
crossref_primary_10_1007_s12369_019_00612_0
crossref_primary_10_1108_EJIM_09_2019_0245
crossref_primary_10_3389_fgene_2023_1039839
crossref_primary_10_1007_s43681_021_00055_2
crossref_primary_10_17645_si_8406
Cites_doi 10.5465/amr.1995.9508080335
10.4018/978-1-60566-354-8.ch010
10.1007/s10677-008-9142-6
10.1017/CBO9780511978036.023
10.1111/j.1756-8765.2010.01094.x
10.1017/CBO9780511978036.028
10.1037/12294-006
10.1016/S0262-4079(11)61113-5
10.1017/CBO9780511978036.024
10.1109/MIS.2006.81
10.1007/s12152-010-9077-1
10.1038/456026a
10.1017/CBO9780511978036.022
10.1017/CBO9780511978036.031
10.5840/tpm20125755
10.1017/CBO9780511978036.025
10.5235/175799611798204923
10.1007/978-3-642-34654-5_45
10.2307/2026228
10.1080/09528130050111428
10.1007/978-3-642-22887-2_16
10.1111/j.1088-4963.2000.00342.x
10.1111/j.1088-4963.2009.01164.x
10.1017/CBO9780511621253
10.1201/9781420085952
10.1017/CBO9780511978036
10.1007/s12559-012-9129-4
10.1007/978-3-540-68677-4_12
ContentType Journal Article
Copyright 2014 Taylor & Francis 2014
Copyright Taylor & Francis Ltd. 2014
Copyright_xml – notice: 2014 Taylor & Francis 2014
– notice: Copyright Taylor & Francis Ltd. 2014
DBID AAYXX
CITATION
JQ2
7SC
7TB
8FD
F28
FR3
L7M
L~C
L~D
DOI 10.1080/0952813X.2014.895108
DatabaseName CrossRef
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Mechanical & Transportation Engineering Abstracts
Technology Research Database
ANTE: Abstracts in New Technology & Engineering
Engineering Research Database
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
ProQuest Computer Science Collection
Technology Research Database
Computer and Information Systems Abstracts – Academic
Mechanical & Transportation Engineering Abstracts
Computer and Information Systems Abstracts
Engineering Research Database
Advanced Technologies Database with Aerospace
ANTE: Abstracts in New Technology & Engineering
Computer and Information Systems Abstracts Professional
DatabaseTitleList
ProQuest Computer Science Collection
Technology Research Database
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 1362-3079
EndPage 372
ExternalDocumentID 3366917201
10_1080_0952813X_2014_895108
895108
Genre Article
Feature
GroupedDBID .4S
.7F
.DC
.QJ
0BK
0R~
29K
2DF
30N
4.4
5GY
5VS
8VB
AAENE
AAJMT
AALDU
AAMIU
AAPUL
AAQRR
ABCCY
ABDBF
ABFIM
ABHAV
ABIVO
ABJNI
ABLIJ
ABPAQ
ABPEM
ABTAI
ABXUL
ABXYU
ACGEJ
ACGFS
ACGOD
ACTIO
ACUHS
ADCVX
ADGTB
ADXPE
AEGXH
AEISY
AEMOZ
AENEX
AEOZL
AEPSL
AEYOC
AFKVX
AGDLA
AGMYJ
AHDZW
AHQJS
AIJEM
AJWEG
AKBVH
AKOOK
AKVCP
ALMA_UNASSIGNED_HOLDINGS
ALQZU
AQRUH
ARCSS
AVBZW
AWYRJ
BLEHA
CCCUG
CS3
D-I
DGEBU
DKSSO
EAP
EBR
EBS
EBU
ECS
EDO
EJD
EMK
EPL
EST
ESX
E~A
E~B
F5P
GTTXZ
H13
HF~
HZ~
H~P
I-F
IPNFZ
J.P
K1G
KYCEM
M4Z
MK~
NA5
NX~
O9-
P2P
PQQKQ
QWB
RIG
RNANH
ROSJB
RTWRZ
S-T
SNACF
TBQAZ
TDBHL
TEN
TFL
TFT
TFW
TH9
TNC
TTHFI
TUROJ
TUS
TWF
UT5
UU3
ZGOLN
ZL0
~S~
AAGDL
AAHIA
AAYXX
ADMLS
AFRVT
AIYEW
CITATION
TASJS
ADYSH
JQ2
7SC
7TB
8FD
F28
FR3
L7M
L~C
L~D
ID FETCH-LOGICAL-c438t-4d0b4d1a6f9dad9086085c0c66ed55c1e26d4fbe954359c488714aa1a030b47d3
ISSN 0952-813X
IngestDate Fri Sep 05 06:44:35 EDT 2025
Fri Jul 25 06:25:17 EDT 2025
Thu Apr 24 23:02:52 EDT 2025
Wed Oct 01 03:54:36 EDT 2025
Wed Dec 25 09:05:08 EST 2024
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c438t-4d0b4d1a6f9dad9086085c0c66ed55c1e26d4fbe954359c488714aa1a030b47d3
Notes SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-2
content type line 23
PQID 1543777002
PQPubID 53008
PageCount 18
ParticipantIDs proquest_miscellaneous_1559649002
crossref_citationtrail_10_1080_0952813X_2014_895108
proquest_journals_1543777002
informaworld_taylorfrancis_310_1080_0952813X_2014_895108
crossref_primary_10_1080_0952813X_2014_895108
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2014-07-03
PublicationDateYYYYMMDD 2014-07-03
PublicationDate_xml – month: 07
  year: 2014
  text: 2014-07-03
  day: 03
PublicationDecade 2010
PublicationPlace Abingdon
PublicationPlace_xml – name: Abingdon
PublicationTitle Journal of experimental & theoretical artificial intelligence
PublicationYear 2014
Publisher Taylor & Francis
Taylor & Francis Ltd
Publisher_xml – name: Taylor & Francis
– name: Taylor & Francis Ltd
References cit0033
cit0034
cit0031
cit0032
cit0030
Cloos C. (cit0013) 2005
cit0039
cit0037
Hanson R. (cit0027) 2001
cit0038
cit0035
cit0036
cit0022
cit0023
cit0064
cit0020
cit0021
cit0062
cit0063
cit0060
cit0061
cit0028
cit0029
Allenby B. (cit0002) 2009
cit0026
cit0024
cit0025
cit0011
cit0055
cit0012
cit0056
cit0053
cit0054
cit0051
cit0052
cit0050
Bringsjord S. (cit0010) 2012
cit0019
cit0017
cit0018
cit0015
cit0059
cit0016
cit0057
cit0058
cit0044
cit0001
cit0045
cit0042
cit0043
cit0040
cit0041
(cit0014) 2012
cit0008
cit0009
cit0006
cit0007
cit0004
cit0048
cit0005
cit0049
cit0046
cit0003
cit0047
References_xml – ident: cit0063
– ident: cit0035
  doi: 10.5465/amr.1995.9508080335
– ident: cit0009
– ident: cit0015
– ident: cit0040
– ident: cit0044
– ident: cit0022
  doi: 10.4018/978-1-60566-354-8.ch010
– ident: cit0048
– ident: cit0054
– ident: cit0029
  doi: 10.1007/s10677-008-9142-6
– ident: cit0050
– ident: cit0025
  doi: 10.1017/CBO9780511978036.023
– ident: cit0020
  doi: 10.1111/j.1756-8765.2010.01094.x
– ident: cit0021
– year: 2001
  ident: cit0027
  publication-title: Journal of Artificial Intelligence Research
– ident: cit0017
  doi: 10.1017/CBO9780511978036.028
– ident: cit0016
  doi: 10.1037/12294-006
– ident: cit0003
  doi: 10.1016/S0262-4079(11)61113-5
– ident: cit0039
– ident: cit0018
– ident: cit0041
– ident: cit0033
  doi: 10.1017/CBO9780511978036.024
– ident: cit0045
– ident: cit0024
  doi: 10.1109/MIS.2006.81
– ident: cit0051
– ident: cit0031
  doi: 10.1007/s12152-010-9077-1
– ident: cit0049
– ident: cit0030
– ident: cit0028
– ident: cit0007
– ident: cit0038
  doi: 10.1038/456026a
– ident: cit0055
– ident: cit0059
– ident: cit0036
  doi: 10.1017/CBO9780511978036.022
– ident: cit0043
  doi: 10.1017/CBO9780511978036.031
– ident: cit0011
  doi: 10.5840/tpm20125755
– ident: cit0012
  doi: 10.1017/CBO9780511978036.025
– ident: cit0034
  doi: 10.5235/175799611798204923
– ident: cit0061
– volume-title: Practical Ethics
  year: 2012
  ident: cit0014
– ident: cit0046
– ident: cit0042
  doi: 10.1007/978-3-642-34654-5_45
– ident: cit0052
– year: 2009
  ident: cit0002
  publication-title: IEEE international symposium on sustainable systems and technology, ISSST '09
– ident: cit0060
  doi: 10.2307/2026228
– ident: cit0023
– year: 2005
  ident: cit0013
  publication-title: American Association for Artificial Intelligence
– ident: cit0001
  doi: 10.1080/09528130050111428
– ident: cit0056
– ident: cit0057
  doi: 10.1007/978-3-642-22887-2_16
– ident: cit0064
– ident: cit0032
  doi: 10.1111/j.1088-4963.2000.00342.x
– ident: cit0008
– ident: cit0006
  doi: 10.1111/j.1088-4963.2009.01164.x
– year: 2012
  ident: cit0010
  publication-title: Topoi
– ident: cit0026
– ident: cit0047
– ident: cit0053
– ident: cit0019
– ident: cit0058
  doi: 10.1017/CBO9780511621253
– ident: cit0005
  doi: 10.1201/9781420085952
– ident: cit0004
  doi: 10.1017/CBO9780511978036
– ident: cit0037
  doi: 10.1007/s12559-012-9129-4
– ident: cit0062
  doi: 10.1007/978-3-540-68677-4_12
SSID ssj0001511
Score 2.2371318
Snippet Many authors have proposed constraining the behaviour of intelligent systems with 'machine ethics' to ensure positive social outcomes from the development of...
SourceID proquest
crossref
informaworld
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 355
SubjectTerms Agents (artificial intelligence)
artificial general intelligence
Artificial intelligence
Complexity
Computation
Constraining
Ethics
Expert systems
Intelligent systems
machine ethics
Risk
Title Limitations and risks of machine ethics
URI https://www.tandfonline.com/doi/abs/10.1080/0952813X.2014.895108
https://www.proquest.com/docview/1543777002
https://www.proquest.com/docview/1559649002
Volume 26
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVEBS
  databaseName: EBSCOhost Academic Search Ultimate
  customDbUrl: https://search.ebscohost.com/login.aspx?authtype=ip,shib&custid=s3936755&profile=ehost&defaultdb=asn
  eissn: 1362-3079
  dateEnd: 20241003
  omitProxy: true
  ssIdentifier: ssj0001511
  issn: 0952-813X
  databaseCode: ABDBF
  dateStart: 19980701
  isFulltext: true
  titleUrlDefault: https://search.ebscohost.com/direct.asp?db=asn
  providerName: EBSCOhost
– providerCode: PRVEBS
  databaseName: EBSCOhost Business Source Ultimate
  customDbUrl:
  eissn: 1362-3079
  dateEnd: 20241003
  omitProxy: false
  ssIdentifier: ssj0001511
  issn: 0952-813X
  databaseCode: AKVCP
  dateStart: 19980701
  isFulltext: true
  titleUrlDefault: https://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=bsu
  providerName: EBSCOhost
– providerCode: PRVEBS
  databaseName: Inspec with Full Text
  customDbUrl:
  eissn: 1362-3079
  dateEnd: 20241003
  omitProxy: false
  ssIdentifier: ssj0001511
  issn: 0952-813X
  databaseCode: ADMLS
  dateStart: 19890101
  isFulltext: true
  titleUrlDefault: https://www.ebsco.com/products/research-databases/inspec-full-text
  providerName: EBSCOhost
– providerCode: PRVLSH
  databaseName: aylor and Francis Online
  customDbUrl:
  mediaType: online
  eissn: 1362-3079
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001511
  issn: 0952-813X
  databaseCode: AHDZW
  dateStart: 19960101
  isFulltext: true
  providerName: Library Specific Holdings
– providerCode: PRVAWR
  databaseName: Taylor & Francis Science and Technology Library-DRAA
  customDbUrl:
  eissn: 1362-3079
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001511
  issn: 0952-813X
  databaseCode: 30N
  dateStart: 19970101
  isFulltext: true
  titleUrlDefault: http://www.tandfonline.com/page/title-lists
  providerName: Taylor & Francis
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3NS8MwFA9zu3jxW5xfVBA8SMfSpGlzc_jBEPS0oXgpaZKCoJtovfjX-9KkXetkflzKaNMk6-_1vZf0vd9D6JioEKexZj6LgtCngIOfqlj6faplX5MskNokON_csuGYXt-H963WWT27JE978uPbvJL_oArnAFeTJfsHZKtO4QT8BnzhCAjD8VcYF9lJLpatjBMvQjOeixBJfapn0ezzDmiD3N9IQD2p0YzmyCUea6yds9W7ySBxZdlBsTR2DzAtIk1JYxsQNCIuavKCPbBK0GRSwbvP61rS5rU7aSA1lUcsza6znsQW4plTzC6SEUYzg5mQOtqLjXcXzwxR-fH9i32qogZxSWfqeklML4ntZQl1goixoI06g-HFw11ljcGjwZZv0f7PMn3S8Kt_M5uGe9Igr50z1oUHMlpDKw45b2DlYB219GQDrZZlOTynpTfRSU0sPBALrxALb5p5Tiw8KxZbaHx1OTof-q4ehi8piXOfqn5KFRYs40ooDotR8JdlXzKmVRhKrAOmaJZqHoIPzCWo5ghTIbAARZ7SSJFt1J5MJ3oHeYzDQhJ8-dCw9VMRCyEyhTmNKc0EyaIuIuVjSKSbsqlZ8pQsAqGL_OquF0uW8kP7uP6Ek7zYpMpsRZmELL51v0QjcW_kWwLLARJFERj5LjqqLoO-NB_BxERP302bkDPKoc3uH2e7h5Znb9A-auev7_oAPNI8PXRC9wkDvoC5
linkProvider Library Specific Holdings
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV07T8MwED5BGWChPEWhQJCQmFLi2kmcESFQgbZTK3WzHD8WIEU0Xfj1nPOoKAiQYI4dO2ff3WfnuzuAc6pDknIT-VHcDX2G6-Cnmis_YEYFhtquMi7AeTCMemN2PwlrNuGsolW6M7QtE0UUttopt7uMrilxlwgLupzQiWNmsQ53IIGvwlroEo24KI5guDDG6NBImW4PFR-71NFz37xlyTst5S79YqsLB3TbhLSeesk7eezM87Sj3j5ldfzXt23BZgVPvatyP23Disl2oFmXfvAqS7ALF0VgVHnb5-FgnqOoz7yp9Z4LdqbxTEGk34Px7c3ouudXNRd8xSjPfaaDlGkiI5toqRM88CAmU4GKIqPDUBHTjTSzqUlCxFmJQvWPCZOSSDQWKYs13YdGNs3MAXhRgocVxIuhywjPJJdSWk0Sxhmzktq4BbSWtVDVlF1djCdB6ryllSyEk4UoZdECf9HrpUzI8Ut7_nEZRV5chNiyaomgP3dt10suKs2eCYScNI5jdCQtOFs8Rp10P1pkZqZz1wa3IkuwzeHfRz-F9d5o0Bf9u-HDEWy4JwVNmLahkb_OzTGCoTw9Kbb7O5eL-YM
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT8MwDLZgSIgLb8R4FgmJU0ezpGl6RMDEc-LApN2iNI8LsE2su_DrcfqYBgiQ4NykSZ3Y_pJ-tgGOqYlJJiwPedKOQ4brEGZG6DBiVkeWura2PsD5vsuveuymH_dnovg9rdKfoV2ZKKKw1V65R8bVjLhTRAVtQWjfE7NYS3iMIOZhgfswUx_EEXWnthj9GSmz7aHeY5c6eO6bt3xwTh9Sl34x1YX_6ayAqmde0k6eWpM8a-m3T0kd__Npq7BcgdPgrNxNazBnB-uwUhd-CCo7sAEnRVhUedcX4FiBJ6iPg6ELXgpupg1sQaPfhF7n8vH8KqwqLoSaUZGHzEQZM0RxlxplUjzuICLTkebcmjjWxLa5YS6zaYwoK9Wo_AlhShGFpiJjiaFb0BgMB3YbAp7iUQXRYuzzwTMllFLOkJQJxpyiLmkCrUUtdTVlXxXjWZI6a2klC-llIUtZNCGc9hqV6Th-aS9mV1HmxTWIK2uWSPpz1716xWWl12OJgJMmSYJupAlH08eokf43ixrY4cS3iVPOUmyz8_fRD2Hx4aIj7667t7uw5B8UHGG6B438dWL3EQnl2UGx2d8BlY_4MA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Limitations+and+risks+of+machine+ethics&rft.jtitle=Journal+of+experimental+%26+theoretical+artificial+intelligence&rft.au=Brundage%2C+Miles&rft.date=2014-07-03&rft.issn=0952-813X&rft.eissn=1362-3079&rft.volume=26&rft.issue=3&rft.spage=355&rft.epage=372&rft_id=info:doi/10.1080%2F0952813X.2014.895108&rft.externalDBID=n%2Fa&rft.externalDocID=10_1080_0952813X_2014_895108
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0952-813X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0952-813X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0952-813X&client=summon