# Mixtral 8x7B Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/mixtral-8x7b
> Markdown URL: https://aitinkerers.org/technologies/mixtral-8x7b.md
> Technology record last updated: 2026-03-06T01:18:00Z
> Generated: 2026-09-21T12:41:31Z

Mixtral 8x7B is a Sparse Mixture of Experts (SMoE) model: it outperforms Llama 2 70B and GPT-3.5 while delivering 6x faster inference.

Mixtral 8x7B (Mistral AI) is a high-performance, open-weight Large Language Model (LLM) built on a Sparse Mixture of Experts (SMoE) architecture. This design leverages eight distinct 'experts' (7B parameters each), activating only two per token: this results in 46.7B total parameters but only 12.9B active parameters per inference, optimizing for speed and cost. The model matches or exceeds GPT-3.5 performance on most benchmarks, handles a 32k token context window, and demonstrates strong multilingual capabilities (English, French, Italian, German, Spanish) and superior code generation.

- Official technology site: https://huggingface.co/mistralai/Mixtral-8x7B-v0.1
- Public AI Tinkerers demos and talks: 2
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Sketch-AI - Infrastructure for Robotics and Automation](https://munich.aitinkerers.org/talks/rsvp_efCiEy-I_vE)

Hardware Selection Copilot for Robotics and Automation Projects

- Event context: AI Tinkerers Munich - January 18 — 2024-01-18 — Munich
- Public talk page: https://munich.aitinkerers.org/talks/rsvp_efCiEy-I_vE

### [Mixtral 8x7B](https://seattle.aitinkerers.org/talks/rsvp_2e202wQPpTI)

Quick walk through the new mixture of experts model

- Event context: AI Tinkerers Seattle - December Meetup — 2023-12-13 — Seattle
- Public talk page: https://seattle.aitinkerers.org/talks/rsvp_2e202wQPpTI

## Related Technologies

- [GPT-3](https://aitinkerers.org/technologies/gpt-3) ([Markdown](https://aitinkerers.org/technologies/gpt-3.md)) — 191 public demos
- [GPT-4](https://aitinkerers.org/technologies/gpt-4) ([Markdown](https://aitinkerers.org/technologies/gpt-4.md)) — 529 public demos
- [Mixture of Experts](https://aitinkerers.org/technologies/mixture-of-experts) ([Markdown](https://aitinkerers.org/technologies/mixture-of-experts.md)) — 1 public demo
- [RAG](https://aitinkerers.org/technologies/rag) ([Markdown](https://aitinkerers.org/technologies/rag.md)) — 147 public demos
- [React](https://aitinkerers.org/technologies/react) ([Markdown](https://aitinkerers.org/technologies/react.md)) — 220 public demos