# Language Models Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/language-models
> Markdown URL: https://aitinkerers.org/technologies/language-models.md
> Technology record last updated: 2026-02-25T10:15:55Z
> Generated: 2026-09-21T06:42:06Z

Language Models (LMs) are deep learning systems—like GPT-4 and Llama 2—trained on massive text datasets to predict and generate human-quality text, code, and conversation.

Language Models are sophisticated deep learning systems, primarily utilizing the Transformer architecture, designed to process and generate natural language. They function as probabilistic prediction engines, estimating the likelihood of a token (word or subword) sequence based on billions or even trillions of learned parameters (e.g., Llama 2 offers models from 7B to 70B parameters). Training involves self-supervised learning on massive, diverse datasets (Common Crawl, digitized books), enabling them to master syntax, semantics, and context. Key applications include advanced text generation, summarization, machine translation, and code generation, effectively powering modern conversational AI and developer tools.

- Official technology site: https://en.wikipedia.org/wiki/Large_language_model
- Public AI Tinkerers demos and talks: 4
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Más allá del RAG: Grafos universales para datos no universales](https://santiago.aitinkerers.org/talks/rsvp_Ic5kPKxkc3I)

Hoy, la mayoría de los sistemas de information retrieval usan arquitecturas tipo RAG o GraphRAG: se basan en búsqueda semántica, embeddings y modelos de lenguaje para recuperar información relevante.

- Event context: Estructura, Risa y Ecosistemas: el nuevo ADN de la IA Chilena — 2025-10-29 — Santiago
- Public talk page: https://santiago.aitinkerers.org/talks/rsvp_Ic5kPKxkc3I

### [TextArena](https://singapore.aitinkerers.org/talks/rsvp_GnJWYL5EEJg)

TextArena is an OpenAI Gym style environment with 57 text based games (single-player, two-player and multi-player) that allows for evaluation and RL based training of the game playing capabilities of language models.

- Event context: AI Tinkerers Singapore: 3rd Meetup - November 19th, 2024 — 2024-11-19 — Singapore
- Public talk page: https://singapore.aitinkerers.org/talks/rsvp_GnJWYL5EEJg

### [AutoGraphRAG](https://la.aitinkerers.org/talks/rsvp_vp11TAOBEsk)

Automatic graph ontologies using dependency parsing to entities and predicates followed by RAG and graph based reranking augmented with community detection

- Event context: June 25th - LA AI Tinkerers Meetup & Demos — 2024-06-26 — Los Angeles
- Public talk page: https://la.aitinkerers.org/talks/rsvp_vp11TAOBEsk

### [Self-healing code from Docs](https://berlin.aitinkerers.org/talks/rsvp_V3U7W4z5oaw)

The idea is basic: generate python code based on library documentation, on which the LLM hasn't been trained. But with the current state of LLMs, this turns out to be overly optimistic. So we relocate the effort of the task to the environment engineering. How can the environment, with which the agent interacts, maximally contribute to the agent's evolution and success? Fortunately, the task of code generation offers a rich feedback loop, from static code analysis tools, to run time execution logs, to code base knowledge graphs. In this talk I will make a demo of the coding assistant and provide a sneak peak into the ongoing process of enriching the environment/agent interaction for optimal agent performance.

- Event context: AI Tinkerers Berlin - November 24 — 2023-11-24 — Berlin
- Public talk page: https://berlin.aitinkerers.org/talks/rsvp_V3U7W4z5oaw

## Related Technologies

- [RAG](https://aitinkerers.org/technologies/rag) ([Markdown](https://aitinkerers.org/technologies/rag.md)) — 147 public demos
- [Apache Lucene](https://aitinkerers.org/technologies/apache-lucene) ([Markdown](https://aitinkerers.org/technologies/apache-lucene.md)) — 2 public demos
- [BM25](https://aitinkerers.org/technologies/bm25) ([Markdown](https://aitinkerers.org/technologies/bm25.md)) — 5 public demos
- [Checkmarx](https://aitinkerers.org/technologies/checkmarx) ([Markdown](https://aitinkerers.org/technologies/checkmarx.md)) — 1 public demo
- [Clang-Tidy](https://aitinkerers.org/technologies/clang-tidy) ([Markdown](https://aitinkerers.org/technologies/clang-tidy.md)) — 1 public demo
- [Community Detection](https://aitinkerers.org/technologies/community-detection) ([Markdown](https://aitinkerers.org/technologies/community-detection.md)) — 1 public demo
- [Coverity](https://aitinkerers.org/technologies/coverity) ([Markdown](https://aitinkerers.org/technologies/coverity.md)) — 1 public demo
- [Dependency Parsing](https://aitinkerers.org/technologies/dependency-parsing) ([Markdown](https://aitinkerers.org/technologies/dependency-parsing.md)) — 1 public demo
- [Elasticsearch](https://aitinkerers.org/technologies/elasticsearch) ([Markdown](https://aitinkerers.org/technologies/elasticsearch.md)) — 5 public demos
- [Embeddings](https://aitinkerers.org/technologies/embeddings) ([Markdown](https://aitinkerers.org/technologies/embeddings.md)) — 22 public demos
- [ESLint](https://aitinkerers.org/technologies/eslint) ([Markdown](https://aitinkerers.org/technologies/eslint.md)) — 1 public demo
- [Execution Logs](https://aitinkerers.org/technologies/execution-logs) ([Markdown](https://aitinkerers.org/technologies/execution-logs.md)) — 1 public demo
- [FAISS](https://aitinkerers.org/technologies/faiss) ([Markdown](https://aitinkerers.org/technologies/faiss.md)) — 17 public demos
- [Fortify](https://aitinkerers.org/technologies/fortify) ([Markdown](https://aitinkerers.org/technologies/fortify.md)) — 1 public demo
- [Graph Ontologies](https://aitinkerers.org/technologies/graph-ontologies) ([Markdown](https://aitinkerers.org/technologies/graph-ontologies.md)) — 1 public demo
- [GraphRAG](https://aitinkerers.org/technologies/graphrag) ([Markdown](https://aitinkerers.org/technologies/graphrag.md)) — 13 public demos
- [HNSW](https://aitinkerers.org/technologies/hnsw) ([Markdown](https://aitinkerers.org/technologies/hnsw.md)) — 7 public demos
- [Klocwork](https://aitinkerers.org/technologies/klocwork) ([Markdown](https://aitinkerers.org/technologies/klocwork.md)) — 1 public demo