HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack

We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, DevOps, Interoperabil...

Full description

Saved in:
Bibliographic Details
Published in2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing pp. 1057 - 1066
Main Authors Fox, Geoffrey C., Qiu, Judy, Kamburugamuve, Supun, Jha, Shantenu, Luckow, Andre
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2015
Subjects
Apache Big Data Stack
Big data
Cloud computing
Distributed databases
Google
HPC
Programming
Security
Online AccessGet full text
DOI10.1109/CCGrid.2015.122

Cover

More Information
Summary:We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, DevOps, Interoperability, File Systems, Cluster & Resource management, Data Transport, File management, NoSQL, SQL (NewSQL), Extraction Tools, Object-relational mapping, In-memory caching and databases, Inter-process Communication, Batch Programming model and Runtime, Stream Processing, High-level Programming, Application Hosting and PaaS, Libraries and Applications, Workflow and Orchestration. We summarize status of these layers focusing on issues of importance for data analytics. We highlight areas where HPC and ABDS have good opportunities for integration.
DOI:10.1109/CCGrid.2015.122