Hetero-DB： Next Generation High-Performance Database Systems by Best Utilizing Heterogeneous Computing and Storage Resources

• Published in: Journal of computer science and technology Vol. 30; no. 4; pp. 657 - 678
• Main Author: 张凯 陈峰 丁晓宁 槐寅 李如豹 罗天 王凯博 袁源 张晓东
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.07.2015; Springer Nature B.V
• Subjects: Artificial Intelligence; Computer Science; Data base management systems; Data storage; Data Structures and Information Theory; Devices; Disk drives; Energy consumption; Engines; Graphics boards; Hard disks; Hardware; Information Systems Applications (incl.Internet); Infrastructure; Optimization techniques; Organizing; Queries; Query processing; Regular Paper; Software; Software Engineering; Studies; Systems design; Theory of Computation; Workloads; 分贝; 图形处理单元; 存储资源; 应用程序; 异构计算; 性能优势; 数据库系统设计; 硬盘驱动器; United States > US; database; SSD; GPU; heterogeneous system
• ISSN: 1000-9000; 1860-4749
• DOI: 10.1007/s11390-015-1553-y

With recent advancement on hardware technologies, new general-purpose high-performance devices have been widely adopted, such as the graphics processing unit （GPU） and solid state drive （SSD）. GPU may offer an order of higher throughput for applications with massive data parallelism, compared with the multicore CPU. Moreover, new storage device SSD is also capable of offering a much higher I/O throughput and lower latency than a traditional hard disk device （HDD）. These new hardware devices can significantly boost the performance of many applications;thus the database community has been actively engaging in adopting them into database systems. However, the performance benefit cannot be easily reaped if the new hardwares are improperly used. In this paper, we propose Hetero-DB, a high-performance database system by exploiting both the characteristics of the database system and the special properties of the new hardware devices in system’s design and implementation. Hetero-DB develops a GPU-aware query execution engine with GPU device memory management and query scheduling mechanism to support concurrent query execution. Furthermore, with the SSD-HDD hybrid storage system, we redesign the storage engine by organizing HDD and SSD into a two-level caching hierarchy in Hetero-DB. To best utilize the hybrid hardware devices, the semantic information that is critical for storage I/O is identified and passed to the storage manager, which has a great potential to improve the e？ciency and performance. Hetero-DB aims to maximize the performance benefits of GPU and SSD, and demonstrates the effectiveness for designing next generation database systems.