The MOMMS Family of Matrix Multiplication Algorithms

As the ratio between the rate of computation and rate with which data can be retrieved from various layers of memory continues to deteriorate, a question arises: Will the current best algorithms for computing matrix-matrix multiplication on future CPUs continue to be (near) optimal? This paper provi...

Full description

Saved in:
Bibliographic Details
Main Authors Smith, Tyler M, van de Geijn, Robert A
Format Journal Article
LanguageEnglish
Published 11.04.2019
Subjects
Online AccessGet full text
DOI10.48550/arxiv.1904.05717

Cover

Abstract As the ratio between the rate of computation and rate with which data can be retrieved from various layers of memory continues to deteriorate, a question arises: Will the current best algorithms for computing matrix-matrix multiplication on future CPUs continue to be (near) optimal? This paper provides compelling analytical and empirical evidence that the answer is "no". The analytical results guide us to a new family of algorithms of which the current state-of-the-art "Goto's algorithm" is but one member. The empirical results, on architectures that were custom built to reduce the amount of bandwidth to main memory, show that under different circumstances, different and particular members of the family become more superior. Thus, this family will likely start playing a prominent role going forward.
AbstractList As the ratio between the rate of computation and rate with which data can be retrieved from various layers of memory continues to deteriorate, a question arises: Will the current best algorithms for computing matrix-matrix multiplication on future CPUs continue to be (near) optimal? This paper provides compelling analytical and empirical evidence that the answer is "no". The analytical results guide us to a new family of algorithms of which the current state-of-the-art "Goto's algorithm" is but one member. The empirical results, on architectures that were custom built to reduce the amount of bandwidth to main memory, show that under different circumstances, different and particular members of the family become more superior. Thus, this family will likely start playing a prominent role going forward.
Author van de Geijn, Robert A
Smith, Tyler M
Author_xml – sequence: 1
  givenname: Tyler M
  surname: Smith
  fullname: Smith, Tyler M
– sequence: 2
  givenname: Robert A
  surname: van de Geijn
  fullname: van de Geijn, Robert A
BackLink https://doi.org/10.48550/arXiv.1904.05717$$DView paper in arXiv
BookMark eNrjYmDJy89LZWCQNDTQM7EwNTXQTyyqyCzTM7Q0MNEzMDU3NOdkMAnJSFXw9ff1DVZwS8zNzKlUyE9T8E0sKcqsUPAtzSnJLMjJTE4syczPU3DMSc8vyizJyC3mYWBNS8wpTuWF0twM8m6uIc4eumDz4wuKMnMTiyrjQfbEg-0xJqwCAAP6M4o
ContentType Journal Article
Copyright http://arxiv.org/licenses/nonexclusive-distrib/1.0
Copyright_xml – notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0
DBID AKY
GOX
DOI 10.48550/arxiv.1904.05717
DatabaseName arXiv Computer Science
arXiv.org
DatabaseTitleList
Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
ExternalDocumentID 1904_05717
GroupedDBID AKY
GOX
ID FETCH-arxiv_primary_1904_057173
IEDL.DBID GOX
IngestDate Wed Jul 23 01:59:08 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-arxiv_primary_1904_057173
OpenAccessLink https://arxiv.org/abs/1904.05717
ParticipantIDs arxiv_primary_1904_05717
PublicationCentury 2000
PublicationDate 2019-04-11
PublicationDateYYYYMMDD 2019-04-11
PublicationDate_xml – month: 04
  year: 2019
  text: 2019-04-11
  day: 11
PublicationDecade 2010
PublicationYear 2019
Score 3.3757288
SecondaryResourceType preprint
Snippet As the ratio between the rate of computation and rate with which data can be retrieved from various layers of memory continues to deteriorate, a question...
SourceID arxiv
SourceType Open Access Repository
SubjectTerms Computer Science - Mathematical Software
Title The MOMMS Family of Matrix Multiplication Algorithms
URI https://arxiv.org/abs/1904.05717
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwY2BQSU01M0szS0nRNbNIStU1MTI01k0ENguAEWKcmgysnxKTwScx-fqZeYSaeEWYRjAxKMD2wiQWVWSWQc4HTirWB9ZWJnpArYbmzAzMwIYCaDOvfwRkchJ8FBdUPUIdsI0JFkKqJNwEGfihrTsFR0h0CDEwpeaJMJgAo0LB19_XN1gBcs2EQn6agi_oaPwKBV_Iej7owJmCY056PrC3npFbLMog7-Ya4uyhC7YnvgByKEQ8yAnxYCcYizGwALvuqRIMCslpiQZJiWYpyalmqSaGyaYWxiCOoXESEJoB-yqSDBK4TJHCLSXNwAWstsFzGoaGMgwsJUWlqbLAqrEkSQ4cPgCLKWfl
linkProvider Cornell University
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+MOMMS+Family+of+Matrix+Multiplication+Algorithms&rft.au=Smith%2C+Tyler+M&rft.au=van+de+Geijn%2C+Robert+A&rft.date=2019-04-11&rft_id=info:doi/10.48550%2Farxiv.1904.05717&rft.externalDocID=1904_05717