DeepSpeed Compression: A composable library for extreme

Large-scale models are revolutionizing deep learning and AI research, driving major improvements in language understanding, generating creative texts, multi-lingual translation and many more. But despite their remarkable capabilities, the models’ large size creates latency and cost constraints that hinder the deployment of applications on top of them. In particular, increased inference time and memory consumption […]

DeepSpeed介绍_deepseed zero-CSDN博客

Practicing Trustworthy Machine Learning: Consistent, Transparent, and Fair AI Pipelines [1 ed.] 1098120272, 9781098120276

GitHub - microsoft/DeepSpeed: DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

GitHub - ciayomin/DeepSpeed_LlaMa: DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Shaden Smith on LinkedIn: DeepSpeed-MoE for NLG: Reducing the training cost of language models by 5…

Jeff Rasley - CatalyzeX

如何评价微软开源的分布式训练框架deepspeed？ - 菩提树的回答- 知乎

PDF) DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale

ZeroQuant与SmoothQuant量化总结-CSDN博客