# Jan-nano-gguf Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/jan-nano-gguf
> Markdown URL: https://aitinkerers.org/technologies/jan-nano-gguf.md
> Technology record last updated: 2026-05-19T10:46:57Z
> Generated: 2026-10-23T17:03:33Z

Jan-nano-gguf is a high-performance, 4-bit quantized Llama-3 model optimized for local inference on consumer-grade hardware.

Engineered by the Jan team, this GGUF implementation leverages 8 billion parameters to deliver low-latency AI responses directly on your desktop. It utilizes advanced quantization techniques to reduce memory overhead (VRAM) while maintaining 95% of the original model's accuracy. By integrating seamlessly with the Jan desktop app and llama.cpp, it enables private, offline execution for developers and researchers requiring high-speed text generation without cloud dependencies.

- Official technology site: https://huggingface.co/jan-hq/Jan-Llama-3-8B-Instruct-GGUF
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Compose and Dragons: Tiny Language Models in Action](https://paris.aitinkerers.org/talks/rsvp_lNiq-CojExE)

- Event context: AI Tinkerers Paris: Docker Agentic Workflows (Devoxx Kickoff) — 2026-04-21 — Paris
- Public talk page: https://paris.aitinkerers.org/talks/rsvp_lNiq-CojExE

## Related Technologies

- [AI agents](https://aitinkerers.org/technologies/ai-agents) ([Markdown](https://aitinkerers.org/technologies/ai-agents.md)) — 35 public demos
- [dice rolls](https://aitinkerers.org/technologies/dice-rolls) ([Markdown](https://aitinkerers.org/technologies/dice-rolls.md)) — 1 public demo
- [Docker](https://aitinkerers.org/technologies/docker) ([Markdown](https://aitinkerers.org/technologies/docker.md)) — 151 public demos
- [granite-embedding 278m](https://aitinkerers.org/technologies/granite-embedding-278m) ([Markdown](https://aitinkerers.org/technologies/granite-embedding-278m.md)) — 1 public demo
- [monsters](https://aitinkerers.org/technologies/monsters) ([Markdown](https://aitinkerers.org/technologies/monsters.md)) — 1 public demo
- [Qwen-2](https://aitinkerers.org/technologies/qwen-2) ([Markdown](https://aitinkerers.org/technologies/qwen-2.md)) — 4 public demos
- [RAG](https://aitinkerers.org/technologies/rag) ([Markdown](https://aitinkerers.org/technologies/rag.md)) — 148 public demos
- [Scratch](https://aitinkerers.org/technologies/scratch) ([Markdown](https://aitinkerers.org/technologies/scratch.md)) — 2 public demos