# DeepSpeed Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/deepspeed
> Markdown URL: https://aitinkerers.org/technologies/deepspeed.md
> Technology record last updated: 2026-03-01T08:55:20Z
> Generated: 2026-10-25T00:00:38Z

DeepSpeed is Microsoft's open-source deep learning optimization library: it enables training and inference for models with trillions of parameters, maximizing scale and speed on existing hardware.

DeepSpeed is your high-performance deep learning optimization library, built by Microsoft Research. It integrates with PyTorch to democratize large-scale AI, handling models up to one trillion parameters with its core technology: the Zero Redundancy Optimizer (ZeRO). ZeRO, combined with 3D Parallelism and ZeRO-Offload, delivers significant efficiency gains: models like Megatron-Turing NLG 530B were trained using this stack. Expect up to 5x system performance improvement and a 1.8x higher throughput compared to state-of-the-art alternatives, making distributed training efficient, effective, and accessible.

- Official technology site: https://www.deepspeed.ai/
- Public AI Tinkerers demos and talks: 2
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Elasticity, scale and production realities](https://paris.aitinkerers.org/talks/rsvp_g6P1G7Bvt40)

- Event context: High-Performance Local AI Development: Kick-off ThinkStation PGX — 2026-03-17 — Paris
- Public talk page: https://paris.aitinkerers.org/talks/rsvp_g6P1G7Bvt40

### [Training Mamba for Long Context Sequences using Deepspeed](https://austin.aitinkerers.org/talks/rsvp_0KxbrCZJ164)

- Event context: Join AI Tinkerers April Meetup — 2024-04-11 — Austin
- Public talk page: https://austin.aitinkerers.org/talks/rsvp_0KxbrCZJ164

## Related Technologies

- [Docker](https://aitinkerers.org/technologies/docker) ([Markdown](https://aitinkerers.org/technologies/docker.md)) — 151 public demos
- [Kubernetes](https://aitinkerers.org/technologies/kubernetes) ([Markdown](https://aitinkerers.org/technologies/kubernetes.md)) — 35 public demos
- [Mamba](https://aitinkerers.org/technologies/mamba) ([Markdown](https://aitinkerers.org/technologies/mamba.md)) — 1 public demo
- [Ray](https://aitinkerers.org/technologies/ray) ([Markdown](https://aitinkerers.org/technologies/ray.md)) — 6 public demos
- [SlimPajama](https://aitinkerers.org/technologies/slimpajama) ([Markdown](https://aitinkerers.org/technologies/slimpajama.md)) — 1 public demo
- [State Space Model](https://aitinkerers.org/technologies/state-space-model) ([Markdown](https://aitinkerers.org/technologies/state-space-model.md)) — 1 public demo
- [Terraform](https://aitinkerers.org/technologies/terraform) ([Markdown](https://aitinkerers.org/technologies/terraform.md)) — 8 public demos
- [Transformers](https://aitinkerers.org/technologies/transformers) ([Markdown](https://aitinkerers.org/technologies/transformers.md)) — 149 public demos