# Local LLM Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/local-llm
> Markdown URL: https://aitinkerers.org/technologies/local-llm.md
> Technology record last updated: 2026-02-25T15:16:43Z
> Generated: 2026-10-25T15:32:36Z

A Large Language Model (LLM) designed to run directly on a user's local hardware (desktop, laptop, or server), ensuring data privacy and low-latency inference.

Local LLMs execute inference on-device, bypassing cloud APIs for superior data control and zero-cost operation (post-hardware). This architecture is critical for sensitive sectors (e.g., finance, legal) requiring strict privacy. Tools like Ollama and LM Studio simplify deployment, allowing users to run powerful open-source models—such as Llama 3 (8B, 70B parameter versions) and Mistral 7B—on consumer-grade GPUs or even CPUs. Performance is optimized via quantization techniques (e.g., GGUF format), making models previously restricted to data centers accessible for offline use and real-time, low-latency applications.

- Official technology site: https://ollama.com/
- Public AI Tinkerers demos and talks: 3
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Building Brushi: A Local VLM Agent That Understands Kids’ Drawings](https://toronto.aitinkerers.org/talks/rsvp_duZsN9qwZvs)

- Event context: AI Tinkerers Toronto - June 2026 - with Relay Financial x PostHog — 2026-06-30 — Toronto
- Public talk page: https://toronto.aitinkerers.org/talks/rsvp_duZsN9qwZvs

### [Facts + Citations” to “Futures + Scenarios”: Building an LLM Scenario Copilot for Company Risk and Opportunity](https://hong-kong.aitinkerers.org/talks/rsvp_uvXwTvALF2U)

- Event context: AI Tinkerers Hong Kong: Deep Dive Series - Deep Dive featuring Spatial Computing and Robotics — 2026-02-05 — Hong Kong
- Public talk page: https://hong-kong.aitinkerers.org/talks/rsvp_uvXwTvALF2U

### [Labrinth generative 90s Website](https://nyc.aitinkerers.org/talks/rsvp_vioB2tgwURY)

- Event context: Demos and Dim Sum with Deel and Apollo — 2025-06-03 — New York City
- Public talk page: https://nyc.aitinkerers.org/talks/rsvp_vioB2tgwURY

## Related Technologies

- [LLM](https://aitinkerers.org/technologies/llm) ([Markdown](https://aitinkerers.org/technologies/llm.md)) — 123 public demos
- [Agent](https://aitinkerers.org/technologies/agent) ([Markdown](https://aitinkerers.org/technologies/agent.md)) — 12 public demos
- [Agentic loop architecture](https://aitinkerers.org/technologies/agentic-loop-architecture) ([Markdown](https://aitinkerers.org/technologies/agentic-loop-architecture.md)) — 1 public demo
- [Anthropic API](https://aitinkerers.org/technologies/anthropic-api) ([Markdown](https://aitinkerers.org/technologies/anthropic-api.md)) — 66 public demos
- [API-hosted LLM](https://aitinkerers.org/technologies/api-hosted-llm) ([Markdown](https://aitinkerers.org/technologies/api-hosted-llm.md)) — 1 public demo
- [child-friendly controls](https://aitinkerers.org/technologies/child-friendly-controls) ([Markdown](https://aitinkerers.org/technologies/child-friendly-controls.md)) — 1 public demo
- [coloring canvas](https://aitinkerers.org/technologies/coloring-canvas) ([Markdown](https://aitinkerers.org/technologies/coloring-canvas.md)) — 1 public demo
- [iOS](https://aitinkerers.org/technologies/ios) ([Markdown](https://aitinkerers.org/technologies/ios.md)) — 8 public demos
- [Next](https://aitinkerers.org/technologies/next) ([Markdown](https://aitinkerers.org/technologies/next.md)) — 188 public demos
- [Ollama](https://aitinkerers.org/technologies/ollama) ([Markdown](https://aitinkerers.org/technologies/ollama.md)) — 79 public demos
- [OpenAI API](https://aitinkerers.org/technologies/openai-api) ([Markdown](https://aitinkerers.org/technologies/openai-api.md)) — 520 public demos
- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) — 686 public demos
- [Rust](https://aitinkerers.org/technologies/rust) ([Markdown](https://aitinkerers.org/technologies/rust.md)) — 57 public demos
- [Swift](https://aitinkerers.org/technologies/swift) ([Markdown](https://aitinkerers.org/technologies/swift.md)) — 19 public demos
- [SwiftUI](https://aitinkerers.org/technologies/swiftui) ([Markdown](https://aitinkerers.org/technologies/swiftui.md)) — 10 public demos
- [VLM](https://aitinkerers.org/technologies/vlm) ([Markdown](https://aitinkerers.org/technologies/vlm.md)) — 3 public demos
- [Web technologies](https://aitinkerers.org/technologies/web-technologies) ([Markdown](https://aitinkerers.org/technologies/web-technologies.md)) — 1 public demo