# DiscoLM Mixtral Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/discolm-mixtral
> Markdown URL: https://aitinkerers.org/technologies/discolm-mixtral.md
> Technology record last updated: 2026-05-02T10:03:01Z
> Generated: 2026-09-22T10:35:13Z

DiscoLM Mixtral is an experimental 8x7b Mixture-of-Experts (MoE) model, a DiscoResearch fine-tune of Mistral AI's Mixtral 8x7b.

This is the **DiscoLM Mixtral 8x7b alpha**, a high-performance, experimental MoE model built on Mistral AI's Mixtral 8x7b architecture. Developed by DiscoResearch's Björn Plüster, the model uses a sparse architecture: 46.7 billion total parameters, with only 12.9 billion active per token for efficiency. It was fine-tuned on specialized datasets, including Synthia, MethaMathQA, and Capybara, with compute resources provided by HessianAI. The project delivers a strong, open-weight language model for advanced text generation and NLP research.

- Official technology site: https://huggingface.co/DiscoResearch/DiscoLM-mixtral-8x7b-v2
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Current trends + advances in Open LLMs - brief roundup by DiscoResearch](https://munich.aitinkerers.org/talks/rsvp_DthW1r8bBm0)

Capability advances over the last few weeks/months enable LLM applications with local / on-premise models, that werent possible until a few weeks/months ago. We want to highlight a few of them with a short demo of DiscoLM German (successor to EM German, the most-downloaded open german-focussed LLM; will be released end of 2023). We´d also like to talk about lessons learned from recent DiscoLM projects (DiscoLM 120b, #3 HF leaderboard + DiscoLM Mixtral, first working Mixtral finetune wordwide) and about trends, datasets + roadmap for open LLM finetuning+customization (LLM-based eval for data filtering, DPO, finetuning for Agent/RAG capabilities ...) and how to get open LLMs into production. (this is a first braindump, exact focus of the talk tbc)

- Event context: AI Tinkerers Munich - January 18 — 2024-01-18 — Munich
- Public talk page: https://munich.aitinkerers.org/talks/rsvp_DthW1r8bBm0

## Related Technologies

- [DiscoLM 120b](https://aitinkerers.org/technologies/discolm-120b) ([Markdown](https://aitinkerers.org/technologies/discolm-120b.md)) — 1 public demo
- [DiscoLM German](https://aitinkerers.org/technologies/discolm-german) ([Markdown](https://aitinkerers.org/technologies/discolm-german.md)) — 1 public demo
- [EM German](https://aitinkerers.org/technologies/em-german) ([Markdown](https://aitinkerers.org/technologies/em-german.md)) — 1 public demo