Autonomous technology and the greater human good

Military and economic pressures are driving the rapid development of autonomous systems. We show that these systems are likely to behave in anti-social and harmful ways unless they are very carefully designed. Designers will be motivated to create systems that act approximately rationally and ration...

Full description

Saved in:
Bibliographic Details
Published inJournal of experimental & theoretical artificial intelligence Vol. 26; no. 3; pp. 303 - 315
Main Author Omohundro, Steve
Format Journal Article
LanguageEnglish
Published Abingdon Taylor & Francis 03.07.2014
Taylor & Francis Ltd
Subjects
AI safety
Artificial intelligence
Autonomous
autonomous systems
Confidence
Economics
Expert systems
Formal method
formal methods
Internet
Military
Protocol
rational drives
rationality
Replication
Routing
Strategy
utility functions
Online AccessGet full text
ISSN0952-813X
1362-3079
DOI10.1080/0952813X.2014.895111

Cover

More Information
Summary:Military and economic pressures are driving the rapid development of autonomous systems. We show that these systems are likely to behave in anti-social and harmful ways unless they are very carefully designed. Designers will be motivated to create systems that act approximately rationally and rational systems exhibit universal drives towards self-protection, resource acquisition, replication and efficiency. The current computing infrastructure would be vulnerable to unconstrained systems with these drives. We describe the use of formal methods to create provably safe but limited autonomous systems. We then discuss harmful systems and how to stop them. We conclude with a description of the 'Safe-AI Scaffolding Strategy' for creating powerful safe systems with a high confidence of safety at each stage of development.
Bibliography:SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-2
content type line 23
ISSN:0952-813X
1362-3079
DOI:10.1080/0952813X.2014.895111