# On-device AI Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/on-device-ai
> Markdown URL: https://aitinkerers.org/technologies/on-device-ai.md
> Technology record last updated: 2026-03-17T15:57:54Z
> Generated: 2026-10-23T06:00:16Z

On-device AI: Local processing of machine learning models directly on the edge device, ensuring sub-millisecond latency and maximum data privacy.

This technology shifts AI model execution from cloud servers to the user's hardware: think smartphones, IoT, and vehicles. It’s powered by specialized silicon (Apple’s Neural Engine, Qualcomm’s Hexagon NPU) and optimized runtimes (Google’s LiteRT, formerly TensorFlow Lite). The key benefits are immediate: ultra-low latency, as data doesn't leave the device; robust privacy, since sensitive information remains local; and reliable offline functionality. For example, Google's Gemini Nano runs on-device for instant summarization, while Qualcomm's Snapdragon 8 Gen 3 enables generative AI features directly on flagship Android phones, pushing performance to the edge.

- Official technology site: https://ai.google.dev/edge/litert
- Public AI Tinkerers demos and talks: 3
- Result page: 1 of 1

## Recent Public Talks and Demos

### [SafeGuide: An Offline AI Assistant for Emergency Guidance](https://tokyo.aitinkerers.org/talks/rsvp_BUBY0p8TQNU)

- Event context: AI Tinkerers Ginza Meetup – January 15, 2026 — 2026-01-15 — Tokyo
- Public talk page: https://tokyo.aitinkerers.org/talks/rsvp_BUBY0p8TQNU

### [Hidden Torch](https://sf.aitinkerers.org/talks/rsvp_tjWLC0-9swQ)

- Event context: AI Tinkerers - San Francisco - January 2025 Meetup — 2025-01-30 — San Francisco
- Public talk page: https://sf.aitinkerers.org/talks/rsvp_tjWLC0-9swQ

### [Physical AI agent for a smarter space - an open source AI hardware reference deisgn](https://austin.aitinkerers.org/talks/rsvp_thZJm5TnHKM)

- Event context: Community AI Demos - October Edition with Live Streaming — 2024-10-10 — Austin
- Public talk page: https://austin.aitinkerers.org/talks/rsvp_thZJm5TnHKM

## Related Technologies

- [alBERT](https://aitinkerers.org/technologies/albert) ([Markdown](https://aitinkerers.org/technologies/albert.md)) — 4 public demos
- [DistilBERT](https://aitinkerers.org/technologies/distilbert) ([Markdown](https://aitinkerers.org/technologies/distilbert.md)) — 2 public demos
- [Edge AI](https://aitinkerers.org/technologies/edge-ai) ([Markdown](https://aitinkerers.org/technologies/edge-ai.md)) — 5 public demos
- [LLMs](https://aitinkerers.org/technologies/llms) ([Markdown](https://aitinkerers.org/technologies/llms.md)) — 84 public demos
- [MiniLM](https://aitinkerers.org/technologies/minilm) ([Markdown](https://aitinkerers.org/technologies/minilm.md)) — 1 public demo
- [MobileBERT](https://aitinkerers.org/technologies/mobilebert) ([Markdown](https://aitinkerers.org/technologies/mobilebert.md)) — 1 public demo
- [Raspberry Pi](https://aitinkerers.org/technologies/raspberry-pi) ([Markdown](https://aitinkerers.org/technologies/raspberry-pi.md)) — 8 public demos
- [SenseCAP Watcher](https://aitinkerers.org/technologies/sensecap-watcher) ([Markdown](https://aitinkerers.org/technologies/sensecap-watcher.md)) — 1 public demo
- [SqueezeBERT](https://aitinkerers.org/technologies/squeezebert) ([Markdown](https://aitinkerers.org/technologies/squeezebert.md)) — 1 public demo
- [Tiny AI](https://aitinkerers.org/technologies/tiny-ai) ([Markdown](https://aitinkerers.org/technologies/tiny-ai.md)) — 1 public demo
- [TinyBERT](https://aitinkerers.org/technologies/tinybert) ([Markdown](https://aitinkerers.org/technologies/tinybert.md)) — 1 public demo
- [Torch](https://aitinkerers.org/technologies/torch) ([Markdown](https://aitinkerers.org/technologies/torch.md)) — 4 public demos