HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack

We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, DevOps, Interoperabil...

Full description

Saved in:
Bibliographic Details
Published in2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing pp. 1057 - 1066
Main Authors Fox, Geoffrey C., Qiu, Judy, Kamburugamuve, Supun, Jha, Shantenu, Luckow, Andre
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2015
Subjects
Apache Big Data Stack
Big data
Cloud computing
Distributed databases
Google
HPC
Programming
Security
Online AccessGet full text
DOI10.1109/CCGrid.2015.122

Cover

Abstract We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, DevOps, Interoperability, File Systems, Cluster & Resource management, Data Transport, File management, NoSQL, SQL (NewSQL), Extraction Tools, Object-relational mapping, In-memory caching and databases, Inter-process Communication, Batch Programming model and Runtime, Stream Processing, High-level Programming, Application Hosting and PaaS, Libraries and Applications, Workflow and Orchestration. We summarize status of these layers focusing on issues of importance for data analytics. We highlight areas where HPC and ABDS have good opportunities for integration.
AbstractList We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These cover Message and Data Protocols, Distributed Coordination, Security & Privacy, Monitoring, Infrastructure Management, DevOps, Interoperability, File Systems, Cluster & Resource management, Data Transport, File management, NoSQL, SQL (NewSQL), Extraction Tools, Object-relational mapping, In-memory caching and databases, Inter-process Communication, Batch Programming model and Runtime, Stream Processing, High-level Programming, Application Hosting and PaaS, Libraries and Applications, Workflow and Orchestration. We summarize status of these layers focusing on issues of importance for data analytics. We highlight areas where HPC and ABDS have good opportunities for integration.
Author Luckow, Andre
Kamburugamuve, Supun
Jha, Shantenu
Qiu, Judy
Fox, Geoffrey C.
Author_xml – sequence: 1
  givenname: Geoffrey C.
  surname: Fox
  fullname: Fox, Geoffrey C.
  email: gcf@indiana.edu
  organization: Sch. of Inf. & Comput., Indiana Univ. Bloomington, Bloomington, IN, USA
– sequence: 2
  givenname: Judy
  surname: Qiu
  fullname: Qiu, Judy
  email: xqiu@indiana.edu
  organization: Sch. of Inf. & Comput., Indiana Univ. Bloomington, Bloomington, IN, USA
– sequence: 3
  givenname: Supun
  surname: Kamburugamuve
  fullname: Kamburugamuve, Supun
  email: skamburu@indiana.edu
  organization: Sch. of Inf. & Comput., Indiana Univ. Bloomington, Bloomington, IN, USA
– sequence: 4
  givenname: Shantenu
  surname: Jha
  fullname: Jha, Shantenu
  email: shantenu.jha@rutgers.edu
  organization: Rutgers Univ., Piscataway, NJ, USA
– sequence: 5
  givenname: Andre
  surname: Luckow
  fullname: Luckow, Andre
  email: andre.luckow@gmail.com
  organization: Rutgers Univ., Piscataway, NJ, USA
BookMark eNotzL1OwzAUQGEjgQSUzgwsfoGE62vXrscm_QlSJSoV5urGvmktaBKlYeDtEYLpSN9w7sV127UsxKOCXCnwz2W5GVLMEdQsV4hXYurdXBnn_RzA4q2YXi6pBgPOaAR7J4pqV2aLYrmXVTqe5I6HphvO1AaWZXfuv8bUHuWqPf1KlIuewollkY5ySSPJ_Ujh40HcNPR54el_J-J9vXorq2z7unkpF9uM0Lgxc7Ul7TRbwwy-qT2RiZFtIAyIwBAMQcToYgTXEPAcVe2sthYwKA16Ip7-vomZD_2QzjR8H5ya4cyj_gHme0k7
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/CCGrid.2015.122
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781479980062
1479980064
EndPage 1066
ExternalDocumentID 7152592
Genre orig-research
GroupedDBID 6IE
6IL
ACM
ALMA_UNASSIGNED_HOLDINGS
APO
CBEJK
GUFHI
LHSKQ
RIE
RIL
ID FETCH-LOGICAL-a247t-7b6a373e64ee09fb9aa4dde6ca2c220e0c4a0d2d7dd07fa0e821b7636602c1303
IEDL.DBID RIE
IngestDate Wed Aug 27 02:46:56 EDT 2025
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a247t-7b6a373e64ee09fb9aa4dde6ca2c220e0c4a0d2d7dd07fa0e821b7636602c1303
PageCount 10
ParticipantIDs ieee_primary_7152592
PublicationCentury 2000
PublicationDate 2015-May
PublicationDateYYYYMMDD 2015-05-01
PublicationDate_xml – month: 05
  year: 2015
  text: 2015-May
PublicationDecade 2010
PublicationTitle 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
PublicationTitleAbbrev CCGrid
PublicationYear 2015
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib040743206
ssib026764721
Score 1.6965528
Snippet We review the High Performance Computing Enhanced Apache Big Data Stack HPC-ABDS and summarize the capabilities in 21 identified architecture layers. These...
SourceID ieee
SourceType Publisher
StartPage 1057
SubjectTerms Apache Big Data Stack
Big data
Cloud computing
Distributed databases
Google
HPC
Programming
Security
Title HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack
URI https://ieeexplore.ieee.org/document/7152592
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Na8IwGA7O007b0LFvcthxqWmaJu1Rq04GDmETvEm-uolQReplv355Wz_G2GG3EnJI0vA-b5LnfR6EHnUSpzkXEQl9D8LhuJMYpklsUsWYM5HN4R5y_CpGU_4yi2cN9HSohXHOVeQzF8Bn9ZZvV2YLV2UdCWY9qQ-4JzIRda3Wfu8wIUEI_bBXOUAjo2Kn5hPStJNlz5sFiIOGcRCCWe4PO5UKTYZnaLwfR00iWQbbUgfm65dE438Heo7ax7o9PDkg0gVquKKFeqNJRrq9_hsGTgeeHCsFcG3p4LviQfFZUQFwdw0Kz7i3-MB9VSrsk1GzbKPpcPCejcjOOYEoxmVJpBYqkpET3Dma5jpVivs4JoxihjHqqOGKWmaltVTmirqEhdpHGiEoM4Bql6hZrAp3hbDgxi-mZsxA8gHHI604zX3aQm2kdXiNWjD_-boWx5jvpn7zd_MtOoX1rxmDd6hZbrbu3qN6qR-q3_kNLOSfTQ
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3PT8IwGG0IHvSkBoy_7cGjG13XtewIA5wKhERIuJG265SQDELGxb_efhs_jPHgrVl6aNfme1_b972H0KNqBmHKuO94tofD4LjT1FQ5gQ4lpUb7SQr3kIMhjyfsdRpMK-hpXwtjjCnIZ8aFZvGWnyz1Bq7KGgLMekIbcI8CxlhQVmvtdg_lAqTQ97uVAThSwrd6Ph4JG1H0vJ6DPKgXuB7Y5f4wVCnwpHeKBruRlDSShbvJlau_fok0_neoZ6h-qNzDoz0mnaOKyWqoHY8ip9XuvGNgdeDRoVYAl6YOtivuZp8FGQC3VqDxjNvzD9yRucQ2HdWLOpr0uuModrbeCY6kTOSOUFz6wjecGUPCVIVSMhvJuJZUU0oM0UyShCYiSYhIJTFN6ikbazgnVAOuXaBqtszMJcKcafszFaUa0g84ICnJSGoTF5L4SnlXqAbzn61KeYzZdurXf39-QMfxeNCf9V-GbzfoBNai5A_eomq-3pg7i_G5ui-W9hu6BqKa
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2015+15th+IEEE%2FACM+International+Symposium+on+Cluster%2C+Cloud+and+Grid+Computing&rft.atitle=HPC-ABDS+High+Performance+Computing+Enhanced+Apache+Big+Data+Stack&rft.au=Fox%2C+Geoffrey+C.&rft.au=Qiu%2C+Judy&rft.au=Kamburugamuve%2C+Supun&rft.au=Jha%2C+Shantenu&rft.date=2015-05-01&rft.pub=IEEE&rft.spage=1057&rft.epage=1066&rft_id=info:doi/10.1109%2FCCGrid.2015.122&rft.externalDocID=7152592