# KServe Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/kserve
> Markdown URL: https://aitinkerers.org/technologies/kserve.md
> Technology record last updated: 2026-03-20T22:35:07Z
> Generated: 2026-10-25T04:06:58Z

KServe is the standard Kubernetes custom resource for deploying high-performance, autoscaling inference services across frameworks like PyTorch, TensorFlow, and XGBoost.

Built on Knative and Istio, KServe simplifies production machine learning by abstracting complex networking and scaling logic. It provides advanced features out of the box: scale-to-zero for cost efficiency, canary rollouts for safe deployments, and standardized protocols like V2 (Open Inference Protocol). Whether you are running Large Language Models via vLLM or traditional Scikit-learn models, KServe handles the heavy lifting of model explainability, outlier detection, and multi-model serving on a unified control plane.

- Official technology site: https://kserve.github.io/website/
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Multimodal Groq Demo](https://denver-boulder.aitinkerers.org/talks/rsvp_TiwUC6zS46U)

- Event context: AI Tinkerers Denver - June Meetup — 2024-06-11 — Denver
- Public talk page: https://denver-boulder.aitinkerers.org/talks/rsvp_TiwUC6zS46U

## Related Technologies

- [Groq](https://aitinkerers.org/technologies/groq) ([Markdown](https://aitinkerers.org/technologies/groq.md)) — 23 public demos
- [Multimodal Models](https://aitinkerers.org/technologies/multimodal-models) ([Markdown](https://aitinkerers.org/technologies/multimodal-models.md)) — 6 public demos
- [ONNX Runtime](https://aitinkerers.org/technologies/onnx-runtime) ([Markdown](https://aitinkerers.org/technologies/onnx-runtime.md)) — 5 public demos
- [OpenVINO](https://aitinkerers.org/technologies/openvino) ([Markdown](https://aitinkerers.org/technologies/openvino.md)) — 1 public demo
- [Seldon Core](https://aitinkerers.org/technologies/seldon-core) ([Markdown](https://aitinkerers.org/technologies/seldon-core.md)) — 1 public demo
- [TensorFlow Serving](https://aitinkerers.org/technologies/tensorflow-serving) ([Markdown](https://aitinkerers.org/technologies/tensorflow-serving.md)) — 1 public demo
- [TensorRT](https://aitinkerers.org/technologies/tensorrt) ([Markdown](https://aitinkerers.org/technologies/tensorrt.md)) — 2 public demos
- [TorchServe](https://aitinkerers.org/technologies/torchserve) ([Markdown](https://aitinkerers.org/technologies/torchserve.md)) — 1 public demo
- [Triton Inference Server](https://aitinkerers.org/technologies/triton-inference-server) ([Markdown](https://aitinkerers.org/technologies/triton-inference-server.md)) — 2 public demos
- [Voice models](https://aitinkerers.org/technologies/voice-models) ([Markdown](https://aitinkerers.org/technologies/voice-models.md)) — 2 public demos