# DiscoLM 120b Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/discolm-120b
> Markdown URL: https://aitinkerers.org/technologies/discolm-120b.md
> Technology record last updated: 2026-05-02T10:03:01Z
> Generated: 2026-09-21T10:51:29Z

DiscoLM 120b is DiscoResearch's 120-billion-parameter, instruction-tuned LLM, built on the Alpindale Goliath merge and scoring 73.198 on the HF Leaderboard.

DiscoLM 120b is DiscoResearch's experimental 120B large language model (LLM), trained by Björn Plüster. The architecture is based on Alpindale's Goliath 120b: a strategic merge of Llama2-70b models. We then applied extensive instruction finetuning, incorporating high-quality open-source datasets like SlimOrca-Dedup and OpenHermes. This process yielded strong results: the model achieved an average score of 73.198 on the Hugging Face Leaderboard tasks, positioning it as a top performer in the >70B parameter class upon its alpha release.

- Official technology site: https://huggingface.co/DiscoResearch/DiscoLM-120b
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Current trends + advances in Open LLMs - brief roundup by DiscoResearch](https://munich.aitinkerers.org/talks/rsvp_DthW1r8bBm0)

Capability advances over the last few weeks/months enable LLM applications with local / on-premise models, that werent possible until a few weeks/months ago. We want to highlight a few of them with a short demo of DiscoLM German (successor to EM German, the most-downloaded open german-focussed LLM; will be released end of 2023). We´d also like to talk about lessons learned from recent DiscoLM projects (DiscoLM 120b, #3 HF leaderboard + DiscoLM Mixtral, first working Mixtral finetune wordwide) and about trends, datasets + roadmap for open LLM finetuning+customization (LLM-based eval for data filtering, DPO, finetuning for Agent/RAG capabilities ...) and how to get open LLMs into production. (this is a first braindump, exact focus of the talk tbc)

- Event context: AI Tinkerers Munich - January 18 — 2024-01-18 — Munich
- Public talk page: https://munich.aitinkerers.org/talks/rsvp_DthW1r8bBm0

## Related Technologies

- [DiscoLM German](https://aitinkerers.org/technologies/discolm-german) ([Markdown](https://aitinkerers.org/technologies/discolm-german.md)) — 1 public demo
- [DiscoLM Mixtral](https://aitinkerers.org/technologies/discolm-mixtral) ([Markdown](https://aitinkerers.org/technologies/discolm-mixtral.md)) — 1 public demo
- [EM German](https://aitinkerers.org/technologies/em-german) ([Markdown](https://aitinkerers.org/technologies/em-german.md)) — 1 public demo