Just read twice: closing the recall gap for recurrent language models - Arora, Simran; Timalsina, Aman; Singhal, Aaryan; Spector, Benjamin; Eyuboglu, Sabri; Zhao, Xinyi; Rao, Ashish; Atri Rudra; Ré, Christopher (arXiv.org, 2024)
Keywords: Algorithms; Context; Hardness; Large language models; Recall; Transformers