https://www.infoq.com InfoQ Distributed Programming News feed https://www.infoq.com/news/2023/11/microsoft-releases-dsfastgen/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Distributed+Programming-news <img src="https://res.infoq.com/news/2023/11/microsoft-releases-dsfastgen/en/headerimage/header%281%29-1699209225367.jpg"/><p>Microsoft has announced the alpha release of DeepSpeed-FastGen, a system designed to improve the deployment and serving of large language models (LLMs). DeepSpeed-FastGen is the synergistic composition of DeepSpeed-MII and DeepSpeed-Inference . DeepSpeed-FastGen is based on the Dynamic SplitFuse technique. The system currently supports several model architectures.</p> <i>By Andrew Hoblitzell</i> Microsoft Distributed Programming Deep Learning GPU Machine Learning Development AI, ML & Data Engineering news Tue, 07 Nov 2023 17:56:00 GMT https://www.infoq.com/news/2023/11/microsoft-releases-dsfastgen/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Distributed+Programming-news Andrew Hoblitzell 2023-11-07T17:56:00Z /news/2023/11/microsoft-releases-dsfastgen/en