# ONNX Runtime Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/onnx-runtime
> Markdown URL: https://aitinkerers.org/technologies/onnx-runtime.md
> Technology record last updated: 2026-03-01T21:38:15Z
> Generated: 2026-10-23T06:00:16Z

ONNX Runtime: The cross-platform, high-performance engine for accelerating machine learning model inferencing and training across diverse hardware.

This is your core engine for optimized ML deployment. ONNX Runtime (ORT) is a cross-platform accelerator that significantly boosts performance for both inferencing and training workloads. It achieves this by applying graph optimizations and leveraging hardware-specific Execution Providers (like CUDA, TensorRT, or CoreML) across CPU, GPU, and NPU targets. ORT supports models from major frameworks (PyTorch, TensorFlow, scikit-learn) converted to the ONNX format. Microsoft relies on it heavily: it powers AI in products like Office, Azure, and Bing, handling over 1 trillion daily inferences and offering proven speedups (e.g., 11% throughput gain over PyTorch for BERT-L pre-training).

- Official technology site: https://onnxruntime.ai
- Public AI Tinkerers demos and talks: 5
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Persistent Semantic Memory for AI Agents — SQLite-vec Instead of a Vector DB](https://zurich.aitinkerers.org/talks/rsvp_DuHc2MBp1uo)

- Event context: AI Tinkerers Zürich: July Build Night with Swisscom Ventures — 2026-07-01 — Zürich
- Public talk page: https://zurich.aitinkerers.org/talks/rsvp_DuHc2MBp1uo

### [Porting Segment Anything: SAM2 in ONNX/C++, SAM3 in thin scripts](https://lausanne.aitinkerers.org/talks/rsvp_HLLk1mziQvk)

- Event context: AI Tinkerers Lausanne April 2026 Meetup — 2026-04-30 — Lausanne
- Public talk page: https://lausanne.aitinkerers.org/talks/rsvp_HLLk1mziQvk

### [On the Impact of Black-box Deployment Strategies for Edge AI on Latency and Model Performance](https://toronto.aitinkerers.org/talks/rsvp_T1O04EKQQPE)

- Event context: AI Tinkerers Toronto - November 2025 Meetup at Shopify! — 2025-11-10 — Toronto
- Public talk page: https://toronto.aitinkerers.org/talks/rsvp_T1O04EKQQPE

### [Multimodal Groq Demo](https://denver-boulder.aitinkerers.org/talks/rsvp_TiwUC6zS46U)

- Event context: AI Tinkerers Denver - June Meetup — 2024-06-11 — Denver
- Public talk page: https://denver-boulder.aitinkerers.org/talks/rsvp_TiwUC6zS46U

### [GGML ONNX Runtime](https://toronto.aitinkerers.org/talks/rsvp_YpYHCIhP8gs)

- Event context: AI Tinkerers Toronto - Inaugural Meetup — 2024-04-11 — Toronto
- Public talk page: https://toronto.aitinkerers.org/talks/rsvp_YpYHCIhP8gs

## Related Technologies

- [ONNX](https://aitinkerers.org/technologies/onnx) ([Markdown](https://aitinkerers.org/technologies/onnx.md)) — 84 public demos
- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) — 684 public demos
- [all-MiniLM-L6-v2](https://aitinkerers.org/technologies/all-minilm-l6-v2) ([Markdown](https://aitinkerers.org/technologies/all-minilm-l6-v2.md)) — 1 public demo
- [C++](https://aitinkerers.org/technologies/c) ([Markdown](https://aitinkerers.org/technologies/c.md)) — 10 public demos
- [Cloudflare D1](https://aitinkerers.org/technologies/cloudflare-d1) ([Markdown](https://aitinkerers.org/technologies/cloudflare-d1.md)) — 3 public demos
- [CUDA](https://aitinkerers.org/technologies/cuda) ([Markdown](https://aitinkerers.org/technologies/cuda.md)) — 15 public demos
- [Docker](https://aitinkerers.org/technologies/docker) ([Markdown](https://aitinkerers.org/technologies/docker.md)) — 150 public demos
- [FastAPI](https://aitinkerers.org/technologies/fastapi) ([Markdown](https://aitinkerers.org/technologies/fastapi.md)) — 187 public demos
- [GGML](https://aitinkerers.org/technologies/ggml) ([Markdown](https://aitinkerers.org/technologies/ggml.md)) — 2 public demos
- [Groq](https://aitinkerers.org/technologies/groq) ([Markdown](https://aitinkerers.org/technologies/groq.md)) — 23 public demos
- [Hugging Face](https://aitinkerers.org/technologies/hugging-face) ([Markdown](https://aitinkerers.org/technologies/hugging-face.md)) — 42 public demos
- [Intel Neural Compressor](https://aitinkerers.org/technologies/intel-neural-compressor) ([Markdown](https://aitinkerers.org/technologies/intel-neural-compressor.md)) — 1 public demo
- [KServe](https://aitinkerers.org/technologies/kserve) ([Markdown](https://aitinkerers.org/technologies/kserve.md)) — 1 public demo
- [llama](https://aitinkerers.org/technologies/llama) ([Markdown](https://aitinkerers.org/technologies/llama.md)) — 48 public demos
- [Multimodal Models](https://aitinkerers.org/technologies/multimodal-models) ([Markdown](https://aitinkerers.org/technologies/multimodal-models.md)) — 6 public demos
- [OpenCV](https://aitinkerers.org/technologies/opencv) ([Markdown](https://aitinkerers.org/technologies/opencv.md)) — 27 public demos
- [OpenVINO](https://aitinkerers.org/technologies/openvino) ([Markdown](https://aitinkerers.org/technologies/openvino.md)) — 1 public demo
- [PyTorch](https://aitinkerers.org/technologies/pytorch) ([Markdown](https://aitinkerers.org/technologies/pytorch.md)) — 274 public demos