# Containerization Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/containerization
> Markdown URL: https://aitinkerers.org/technologies/containerization.md
> Technology record last updated: 2026-03-05T10:24:53Z
> Generated: 2026-09-21T13:41:21Z

Containerization packages an application with all its dependencies (code, runtime, config) into a portable unit: the container image, ensuring consistent execution across any environment.

This technology is a game-changer: it virtualizes the OS kernel, not the entire operating system like a traditional VM, drastically cutting resource overhead. Tools like Docker create the container images, which are static blueprints; the container runtime executes them as isolated processes, sharing the host OS efficiently. This isolation guarantees application portability, eliminating 'works on my machine' issues. For orchestration at scale, Kubernetes manages these containers, providing automated deployment, scaling, and self-healing capabilities, ultimately delivering faster deployment cycles and significant cost reductions over legacy virtualization.

- Official technology site: https://docs.docker.com/get-started/overview/
- Public AI Tinkerers demos and talks: 3
- Result page: 1 of 1

## Recent Public Talks and Demos

### [GPU-Streaming Omniverse to the Browser Per‑Org Sessions over WebRTC](https://miami.aitinkerers.org/talks/rsvp_Mq1fLtz3A-E)

Live build walkthrough of a prototype that spins up an isolated NVIDIA Omniverse/Kit session per organization, then streams it into a standard web browser via WebRTC. I’ll show the end-to-end flow: request → provision Azure GPU instance → boot the Kit runtime → establish a WebRTC connection → interact in-scene → teardown/cleanup. Focus is on the state machine, orchestration, and the practical failure modes (startup latency, ICE/networking, cleanup).

- Event context: AI Tinkerers Miami Meetup — The 2026 Builder Kickoff — 2026-02-11 — Miami
- Public talk page: https://miami.aitinkerers.org/talks/rsvp_Mq1fLtz3A-E

### [Pinakes - multimodal note/thought organizer and filer.](https://prague.aitinkerers.org/talks/rsvp_w6HjXKdbuBo)

Pinakes (from the name of the first library catalog) is a tool which produces hierarchical and structured knowledge base/notes from disorganized multimodal snippets of what you want to remember. Some examples: "I need to investigate this new nano banana pro model from google" -> gets filed under /tech/exploration Equations you have derived and want to reference in the future -> upload their image -> transcribed notes get filed under /projects/engine/state_equation

- Event context: AI Tinkerers Prague: Annual Christmas Meetup 2025 — 2025-12-16 — Prague
- Public talk page: https://prague.aitinkerers.org/talks/rsvp_w6HjXKdbuBo

### [How to use Open Source frameworks for Serverless Inference Deployment](https://sf.aitinkerers.org/talks/rsvp_SB7HgWS1kBA)

Serverless deployment promises benefits like auto-scaling, granular billing, and multi-framework support, but often at the cost of inferencing speed. In this short talk, you’ll learn how to enable a true serverless experience on top of Triton Inference Server. This maintains Triton’s optimized inferencing speed while adding auto-scaling from 0 to N servers without infrastructure management. We’ll cover how to leverage Triton’s packaging capabilities to optimize any model for inferencing based on utilization, batching, and concurrency needs.

- Event context: AI Tinkerers SF - September Meetup🤖🔄🧠 — 2023-09-22 — San Francisco
- Public talk page: https://sf.aitinkerers.org/talks/rsvp_SB7HgWS1kBA

## Related Technologies

- [Docker](https://aitinkerers.org/technologies/docker) ([Markdown](https://aitinkerers.org/technologies/docker.md)) — 147 public demos
- [Azure GPU VMs](https://aitinkerers.org/technologies/azure-gpu-vms) ([Markdown](https://aitinkerers.org/technologies/azure-gpu-vms.md)) — 1 public demo
- [FastAPI](https://aitinkerers.org/technologies/fastapi) ([Markdown](https://aitinkerers.org/technologies/fastapi.md)) — 181 public demos
- [ICE](https://aitinkerers.org/technologies/ice) ([Markdown](https://aitinkerers.org/technologies/ice.md)) — 1 public demo
- [Inferless](https://aitinkerers.org/technologies/inferless) ([Markdown](https://aitinkerers.org/technologies/inferless.md)) — 1 public demo
- [Multimodal LLM](https://aitinkerers.org/technologies/multimodal-llm) ([Markdown](https://aitinkerers.org/technologies/multimodal-llm.md)) — 3 public demos
- [NVIDIA Omniverse Kit](https://aitinkerers.org/technologies/nvidia-omniverse-kit) ([Markdown](https://aitinkerers.org/technologies/nvidia-omniverse-kit.md)) — 1 public demo
- [Orchestration](https://aitinkerers.org/technologies/orchestration) ([Markdown](https://aitinkerers.org/technologies/orchestration.md)) — 7 public demos
- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) — 662 public demos
- [Runtime](https://aitinkerers.org/technologies/runtime) ([Markdown](https://aitinkerers.org/technologies/runtime.md)) — 10 public demos
- [Serverless](https://aitinkerers.org/technologies/serverless) ([Markdown](https://aitinkerers.org/technologies/serverless.md)) — 4 public demos
- [TBD](https://aitinkerers.org/technologies/tbd) ([Markdown](https://aitinkerers.org/technologies/tbd.md)) — 2 public demos
- [Triton Inference Server](https://aitinkerers.org/technologies/triton-inference-server) ([Markdown](https://aitinkerers.org/technologies/triton-inference-server.md)) — 2 public demos
- [WebRTC](https://aitinkerers.org/technologies/webrtc) ([Markdown](https://aitinkerers.org/technologies/webrtc.md)) — 12 public demos