MoESys: A Distributed and Efficient Mixture-of-Experts Training and Inference System for Internet Services - Yu, Dianhai; Shen, Liang; Hao, Hongxiang; Gong, Weibao; Wu, Huachao; Bian, Jiang; Dai, Lirong; Xiong, Haoyi (IEEE transactions on services computing, 2024)
Keywords: Biological system modeling; Computational modeling; Data models; Distributed inference; distributed training; large models for internet services; Load modeling; Memory management; MoE; Training; Web and internet services