By A Mystery Man Writer
Last month, the DeepSpeed Team announced ZeRO-Infinity, a step forward in training models with tens of trillions of parameters. In addition to creating optimizations for scale, our team strives to introduce features that also improve speed, cost, and usability. As the DeepSpeed optimization library evolves, we are listening to the growing DeepSpeed community to learn […]
DeepSpeed: Microsoft Research blog - Microsoft Research
DeepSpeed: Microsoft Research blog - Microsoft Research
PDF) DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
Ecosystem Day 2021
The Mathematics of Training LLMs — with Quentin Anthony of Eleuther AI
DeepSpeed - Microsoft Research
DeepSpeed Inference - Enabling Efficient Inference of Transformer Models at Unprecedented Scale, PDF, Graphics Processing Unit
LLM(十二):DeepSpeed Inference 在LLM 推理上的优化探究- 知乎
www.researchgate.net/publication/348131595/figure/
LLM(十二):DeepSpeed Inference 在LLM 推理上的优化探究- 知乎
DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research
DeepSpeed powers 8x larger MoE model training with high performance - Microsoft Research
DeepSpeed
9 libraries for parallel & distributed training/inference of deep learning models, by ML Blogger