Multimodal interaction with W3C standards : toward natural user interfaces to everything

• Other Authors: Dahl, Deborah Anna (Editor)
• Format: Electronic eBook
• Language: English
• Published: Cham : Springer, 2016, ©2017.
• Subjects: Multimodal user interfaces (Computer systems); elektronické knihy; electronic books
• ISBN: 9783319428161; 9783319428147
• Physical Description: 1 online resource

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as sma...

Table of Contents:

• Foreword; Preface; Acknowledgments; Contents; Introduction; Multimodal Interaction Standards; Speech and Multimodal Interaction; Multimodal Interaction Standards; How the Standards Fit Together; Formats for Controlling Processors; Communications Among Components; Representation of Input and Output; Representing Uninterpreted Input; Representing Interpreted User Input; Extensible Multimodal Annotation; Emotion ML; Representing the Semantics of System Output; EMMA 2.0; Overview of Sections; Part I Standards; Part II Platforms; Part III Applications; Part IV Future Directions; References.
• Part I: StandardsChapter 1: Introduction to the Multimodal Architecture Specification; 1.1 Overview; 1.2 The Architecture; 1.3 The Interfaces; 1.4 Some Examples; 1.5 Adding a New Modality Component; 1.6 Conclusion; References; Chapter 2: The Role and Importance of Speech Standards; 2.1 Introduction; 2.2 Quick Tour of W3C VBWG Major Standards; 2.2.1 VoiceXML 2.0; 2.2.2 VoiceXML 2.1; 2.2.3 SRGS 1.0; 2.2.4 SISR 1.0; 2.2.5 SSML 1.0 and 1.1; 2.2.6 PLS 1.0; 2.2.7 CCXML 1.0; 2.3 IETF, Companion Protocols; 2.4 Current Trends and Future Evolutions; 2.4.1 IVR in the Multi-Channel World.
• 2.4.2 Virtual Assistants2.4.3 Multimodal Interfaces; 2.4.4 Internet of Things; 2.5 Conclusion; References; Chapter 3: Extensible Multimodal Annotation for Intelligent Interactive Systems; 3.1 Introduction; 3.2 The Basics of EMMA; 3.3 Capturing Ambiguity and Non-determinacy; 3.4 Groups, Sequences, and Derivations; 3.5 Extending EMMA to System Outputs; 3.6 JSON Representation for EMMA; 3.7 Conclusion; References; 4: EmotionML; 4.1 Introduction; 4.2 Use Cases and Requirements; 4.3 Previous Work; 4.4 Emotion Markup Language Elements; 4.4.1 Representations of Emotion.
• 4.4.2 Mechanism for Referring to an Emotion Vocabulary4.4.3 Meta-Information; 4.4.4 References to the "Rest of the World"; 4.4.5 Time; 4.4.6 Representing Continuous Values and Dynamic Changes; 4.5 Vocabularies; 4.6 Applications; 4.6.1 Data Annotation; 4.6.2 Emotion Recognition; 4.6.3 Emotion Generation; 4.6.4 Platforms and Projects; 4.7 Conclusions; References; Chapter 5: Introduction to SCXML; 5.1 Overview; 5.2 Basic State Machine Concepts; 5.3 Extensions to Basic State Machines; 5.3.1 Data Model; 5.4 Operations and Conditions; 5.5 Executable Content; 5.6 External Communications.
• 5.7 Invoking Platform Resources5.8 Compound States; 5.9 Selecting Transitions; 5.10 Parallel States; 5.11 Conclusion; References; 6: Dialogue Act Annotation with the ISO 24617-2 Standard; 6.1 Introduction; 6.2 Annotating with ISO 24617-2; 6.2.1 Features of the ISO 25617-2 Annotation Standard; 6.2.2 Multidimensional Segmentation; 6.2.3 The Dialogue Act Markup Language (DiAML); 6.3 Experiences in the Use of ISO 24617-2; 6.3.1 Communicative Function Recognition; 6.3.2 Dimension Recognition; 6.3.3 Machine-Learned Dialogue Act Recognition; 6.3.4 Qualifier Recognition; 6.4 Annotated Corpora.