Adaptive online data compression

Quickly transmitting large datasets in the context of distributed computing on wide area networks can be achieved by compressing data before transmission, However such an approach is not efficient when dealing with higher speed networks. Indeed, the time to compress a large file and to send it is gr...

Full description

Saved in:
Bibliographic Details
Published in11th International Symposium on High-Performance Distributed Computing (HPDC-11 2002) pp. 379 - 388
Main Authors Jeannot, E., Knutsson, B., Bjorkman, M.
Format Conference Proceeding
LanguageEnglish
Published IEEE 2002
Subjects
Algorithm design and analysis
Bandwidth
Concurrent computing
Data compression
Distributed computing
File systems
Laboratories
LAN interconnection
Network servers
Spine
Online AccessGet full text
ISBN0769516866
9780769516868
ISSN1082-8907
DOI10.1109/HPDC.2002.1029938

Cover

Abstract Quickly transmitting large datasets in the context of distributed computing on wide area networks can be achieved by compressing data before transmission, However such an approach is not efficient when dealing with higher speed networks. Indeed, the time to compress a large file and to send it is greater than the time to send the uncompressed file. In this paper we explore and enhance an algorithm that allows us to overlap communications with compression and to automatically adapt the compression effort to currently available network and processor resources.
AbstractList Quickly transmitting large datasets in the context of distributed computing on wide area networks can be achieved by compressing data before transmission, However such an approach is not efficient when dealing with higher speed networks. Indeed, the time to compress a large file and to send it is greater than the time to send the uncompressed file. In this paper we explore and enhance an algorithm that allows us to overlap communications with compression and to automatically adapt the compression effort to currently available network and processor resources.
Author Knutsson, B.
Bjorkman, M.
Jeannot, E.
Author_xml – sequence: 1
  givenname: E.
  surname: Jeannot
  fullname: Jeannot, E.
  email: ejeannot@loria.fr
  organization: LORIA, Univ. Henri Poincare, Nancy, France
– sequence: 2
  givenname: B.
  surname: Knutsson
  fullname: Knutsson, B.
  email: bjornk@dsl.cis.upenn.edu
  organization: Distr. Syst. Lab., Univ. of Pennsylvania, Philadelphia, PA, USA
– sequence: 3
  givenname: M.
  surname: Bjorkman
  fullname: Bjorkman, M.
  email: Mats.Bjorkman@mdh.se
  organization: Dept. of Comput. Eng., Malardalens hogskola, Sweden
BookMark eNotj0tLw0AUhQesYFv7A8RNVu4S7zwyj2WJjwoFXeg6TGZuYCSZxEwq-O8NtGdzNh8f52zIKg4RCbmjUFAK5vHw8VQVDIAVFJgxXF-RDShpSiq1lCuypqBZrg2oG7JL6RuWiFIYgDXJ9t6Oc_jFbIhdiJh5O9vMDf04YUphiLfkurVdwt2lt-Tr5fmzOuTH99e3an_MAwM554qDRCq8x9ZhyQ2KFqkT3HjgyilEBwYVKCYbKJVojGylK51vtFgWS8u35OHsHafh54RprvuQHHadjTicUs0p5VIrvYD3ZzAgYj1OobfTX315zv8B7Q1M_g
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/HPDC.2002.1029938
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Computer and Information Systems Abstracts
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EndPage 388
ExternalDocumentID 1029938
Genre Conference Paper
GroupedDBID 29P
6IE
6IF
6IK
6IL
6IN
AAJGR
AAWTH
ACGFS
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IPLJI
M43
OCL
RIE
RIL
RNS
7SC
8FD
AAVQY
JQ2
L7M
L~C
L~D
RIB
RIC
ID FETCH-LOGICAL-i206t-7306e14ddefce539e4fe1c439d037c7eec09e70726b0574b96f6c5cdb849936a3
IEDL.DBID RIE
ISBN 0769516866
9780769516868
ISSN 1082-8907
IngestDate Fri Jul 11 03:15:39 EDT 2025
Wed Aug 27 02:44:08 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i206t-7306e14ddefce539e4fe1c439d037c7eec09e70726b0574b96f6c5cdb849936a3
Notes SourceType-Conference Papers & Proceedings-1
ObjectType-Conference Paper-1
content type line 25
PQID 31136878
PQPubID 23500
PageCount 10
ParticipantIDs ieee_primary_1029938
proquest_miscellaneous_31136878
PublicationCentury 2000
PublicationDate 20020000
20020724
PublicationDateYYYYMMDD 2002-01-01
2002-07-24
PublicationDate_xml – year: 2002
  text: 20020000
PublicationDecade 2000
PublicationTitle 11th International Symposium on High-Performance Distributed Computing (HPDC-11 2002)
PublicationTitleAbbrev HPDC
PublicationYear 2002
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0000454900
ssj0020127
Score 1.6782684
Snippet Quickly transmitting large datasets in the context of distributed computing on wide area networks can be achieved by compressing data before transmission,...
Quickly transmitting large datasets in the context of distributed computing on wide area networks can be achieved by compressing data before transmission....
SourceID proquest
ieee
SourceType Aggregation Database
Publisher
StartPage 379
SubjectTerms Algorithm design and analysis
Bandwidth
Concurrent computing
Data compression
Distributed computing
File systems
Laboratories
LAN interconnection
Network servers
Spine
Title Adaptive online data compression
URI https://ieeexplore.ieee.org/document/1029938
https://www.proquest.com/docview/31136878
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LS8NAEB7anjxVbcX6zMGjiUmz2cdRqqUIlR4s9Bayj4AIadHk4q93NrupoB68JZCQzLIz-83MNzMANwjhKVpEGVLN4pCUUxVKzstQo8ciCiqV1LZQePlMF2vytMk2Pbjd18IYY1rymYnsZZvL11vV2FAZajgaz5T3oc-YcLVa-3iKbSUnLB3SO1s2perI9ajx6AE6lx3xBOWU-s473T336c4kFneL1cOsZS5E_mt-7MovW90eQPMhLLtfd7yTt6ipZaQ-f3R1_K9shzD-LvULVvtD7Ah6pjqGYTfrIfCqP4LgXhc7axoD11sjsNTSwBLSHZG2GsN6_vgyW4R-ukL4Oo1pHaJqU5MQNG-lMlkqDClNohCf6DhlihmjYmFYzKZUIqYjUtCSqkxpydFJSmmRnsCg2lbmFAKCD5IyY4rqgtiWZrGw9b2KI1ZIZJJOYGQFzneugUbuZZ3AdbekOW5qm6koKrNtPvLUTprhjJ_9_eI5HLRDWdpIyAUM6vfGXCI2qOVVuym-AFJ6r8U
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT4NAEJ7UetBT1dZYX-XgURDKsrscTbVBbZse2qQ3wj5IjAltFC7-emdhWxP14A0SCMxmZ_abmW9mAG4QwlO0iMKlivkuyYfSFZznrkKPJc6okEKZQuHpjCZL8ryKVi243dXCaK1r8pn2zGWdy1drWZlQGWo4Gs-Q78F-hF4Fa6q1dhEV00wuNoRI626ZpGpDr0edRx-wcdoRUVBOqe29s73nNuEZ-PFdMn8Y1dwFz37PDl75Za3rI2jcgen25xvmyZtXlcKTnz_6Ov5XuiPofRf7OfPdMXYMLV2cQGc77cGxyt8F515lG2Mcnaa7hmPIpY6hpDdU2qIHy_HjYpS4dr6C-zr0aemiclMdEDRwudRRGGuS60AiQlF-yCTTWvqxZj4bUoGojoiY5lRGUgmOblJIs_AU2sW60GfgEHyQ5BGTVGXENDXzY1PhKzmihUAEYR-6RuB007TQSK2sfRhslzTFbW1yFVmh19VHGppZM5zx879fHMBBsphO0snT7OUCDusRLXVc5BLa5XulrxAplOK63iBfyZizFg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=11th+International+Symposium+on+High-Performance+Distributed+Computing+%28HPDC-11+2002%29&rft.atitle=Adaptive+Online+Data+Compression&rft.au=Jeannot%2C+Emmanuel&rft.au=Knutsson%2C+Bjorn&rft.au=Bjorkman%2C+Mats&rft.date=2002-07-24&rft.isbn=9780769516868&rft_id=info:doi/10.1109%2FHPDC.2002.1029938&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1082-8907&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1082-8907&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1082-8907&client=summon