When the levee breaks: a practical guide to sketching algorithms for processing the flood of genomic data

• Published in: Genome Biology Vol. 20; no. 1; p. 199
• Main Author: Rowe, Will P. M.
• Format: Journal Article
• Language: English
• Published: London BioMed Central 13.09.2019; Springer Nature B.V; BMC
• Subjects: Algorithms; Animal Genetics and Genomics; Bioinformatics; Biomedical and Life Sciences; Data Compression; Data processing; Evolutionary Biology; fields; floods; genome; Genomes; Genomics; Genomics - methods; Human Genetics; Life Sciences; Microbial Genetics and Genomics; Plant Genetics and Genomics; Researchers; Review; Software; Streaming media; utilities; United Kingdom > UK
• ISSN: 1474-760X; 1474-7596; 1474-760X
• DOI: 10.1186/s13059-019-1809-x

Considerable advances in genomics over the past decade have resulted in vast amounts of data being generated and deposited in global archives. The growth of these archives exceeds our ability to process their content, leading to significant analysis bottlenecks. Sketching algorithms produce small, approximate summaries of data and have shown great utility in tackling this flood of genomic data, while using minimal compute resources. This article reviews the current state of the field, focusing on how the algorithms work and how genomicists can utilize them effectively. References to interactive workbooks for explaining concepts and demonstrating workflows are included at https://github.com/will-rowe/genome-sketching .