FATHOM: Fast Attention Through Optimizing Memory - Binder, Elliott; Sudarsanam, Arvind; Sunkavalli, Ravi; Low, Tze Meng (Proceedings - IEEE International Parallel and Distributed Processing Symposium, 2025)
Keywords: attention; Computational modeling; Graphics processing units; Kernel; Layout; Libraries; linear algebra libraries; Matrices; matrix multiplication; Memory management; memory-bound; Spectral efficiency; Throughput; Transformers