# Horovod Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/horovod
> Markdown URL: https://aitinkerers.org/technologies/horovod.md
> Technology record last updated: 2026-03-03T21:27:13Z
> Generated: 2026-09-23T07:40:00Z

Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet that scales model training to hundreds of GPUs with minimal code changes.

Originally developed by Uber, Horovod utilizes the ring-allreduce algorithm via NVIDIA NCCL or MPI to optimize communication between nodes. It eliminates the bottleneck of centralized parameter servers, allowing users to scale a single-GPU training script to a massive cluster by adding just a few lines of Python. Major organizations like Alibaba and Amazon use it to achieve nearly linear scaling efficiency (often exceeding 90%) across thousands of high-performance accelerators.

- Official technology site: https://github.com/horovod/horovod
- Public AI Tinkerers demos and talks: 0
- Result page: 1 of 1

## Recent Public Talks and Demos

No public projects are currently indexed for this technology.