# LPU architecture Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/lpu-architecture
> Markdown URL: https://aitinkerers.org/technologies/lpu-architecture.md
> Technology record last updated: 2026-02-27T09:23:52Z
> Generated: 2026-09-23T01:38:47Z

The Language Processing Unit (LPU) architecture, developed by Groq, is an ASIC designed for ultra-low-latency AI inference, leveraging a deterministic, software-first approach.

Groq’s Language Processing Unit (LPU) architecture is a custom-built Application-Specific Integrated Circuit (ASIC) engineered to eliminate latency in AI inference, particularly for Large Language Models (LLMs). The LPU achieves its speed by employing a programmable assembly line architecture and integrating memory directly on-chip (SRAM), bypassing the traditional memory wall bottleneck that slows down GPUs. This design enables deterministic execution, meaning every step is predictable to the clock cycle, which allows for a massive effective memory bandwidth—up to 80 TB/s—and delivers real-world performance like running Llama-2 70B at over 300 tokens per second per user. It is purpose-built for the decode phase of generative AI, ensuring near-instant response times.

- Official technology site: https://groq.com/
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [ScribeWizard and StockBot powered by Groq](https://amsterdam.aitinkerers.org/talks/rsvp_RTwPC4SIFKM)

ScribeWizard and Stockbot are 2 AI applications developed and run on our GroqCloud. We will demonstrate these 2 apps and talk through development with GroqCloud. If time permits a technical deep dive in our LPU architecture and software stack will also be explored.

- Event context: AI Tinkerers Amsterdam - September — 2024-09-25 — Amsterdam
- Public talk page: https://amsterdam.aitinkerers.org/talks/rsvp_RTwPC4SIFKM

## Related Technologies

- [GroqCloud](https://aitinkerers.org/technologies/groqcloud) ([Markdown](https://aitinkerers.org/technologies/groqcloud.md)) — 3 public demos
- [Groq LPU](https://aitinkerers.org/technologies/groq-lpu) ([Markdown](https://aitinkerers.org/technologies/groq-lpu.md)) — 2 public demos
- [ScribeWizard](https://aitinkerers.org/technologies/scribewizard) ([Markdown](https://aitinkerers.org/technologies/scribewizard.md)) — 1 public demo
- [StockBot](https://aitinkerers.org/technologies/stockbot) ([Markdown](https://aitinkerers.org/technologies/stockbot.md)) — 1 public demo