A Multi-Channel Embedded DSP Closed-Loop Control System for Musical Robots

• Published in: Proceedings of the ... IEEE/RSJ International Conference on Intelligent Robots and Systems pp. 2951 - 2958
• Main Authors: Long, Jason, Murphy, Jim, Carnegie, Dale A., Kapur, Ajay
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.11.2019
• Subjects: Computers; Digital Signal Processing; Hardware; Information retrieval; MIDI; Music; Musical Information Retrieval; Musical Robotics; Portable computers; Real-time systems; Reliability; Robot control; Robots; Signal processing algorithms
• ISSN: 2153-0866
• DOI: 10.1109/IROS40897.2019.8967687

The continuous automatic calibration of musical robots is an important step toward enabling them to create accurate, reliable, and expressive performances. Several attempts have been made to achieve this using external laptops, single-board computers and off-the-shelf hardware, but these solutions have various drawbacks that preclude their use in many musical robotics contexts. This paper presents a new, custom-built embedded DSP system that is capable of up to 32 channels of high quality audio input and output, created to carry out musical information retrieval tasks on the sonic output of musical robots in real time while they are performing. The results of these analyses are continuously fed to musical robot control hardware in order to inform their performance. The design and construction of the circuit board is described, the Musical Information Retrieval (MIR)-based algorithms carried out by the board are outlined, the system's performance in representative applications are evaluated, and its various implications to the field of musical robotics and beyond are discussed. By integrating this system into new musical robots, the result is instruments that are able to 'listen' to the audible results of their own actuations in real time, and continuously calibrate their actions to best represent the intentions of the programmed musical composition or live input.