# ARKit Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/arkit
> Markdown URL: https://aitinkerers.org/technologies/arkit.md
> Technology record last updated: 2026-02-24T00:35:05Z
> Generated: 2026-09-20T19:46:35Z

ARKit is Apple's augmented reality framework: it integrates device motion tracking and scene understanding to build immersive AR experiences on iOS, iPadOS, and visionOS.

ARKit is the core framework for developing augmented reality applications across Apple's platforms, leveraging the device's camera and motion sensors for precise world tracking (6 degrees of freedom). It provides essential capabilities: plane detection (identifying horizontal and vertical surfaces), light estimation for realistic rendering, and advanced features like Location Anchors and Motion Capture (tracking human body movement). Since its debut with iOS 11, developers have used ARKit to power high-fidelity applications, from virtual furniture placement (e.g., IKEA Place) to interactive AR games, reaching hundreds of millions of users globally.

- Official technology site: https://developer.apple.com/arkit/
- Public AI Tinkerers demos and talks: 3
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Teaching an LLM to be an interior designer](https://nyc.aitinkerers.org/talks/rsvp_G0dtIg_V-Dw)

A pipeline that turns a LiDAR room scan into art-placement decisions — which wall, what size, what art — by converting usdz geometry into per-wall design constraints that drive image generation, with a vision-LLM design critic whose judgments are verified, calibrated, and used to teach the deterministic scoring engine. Live, I'll walk the raw scan data (the LiDAR mesh and its JSON), the geometry visualizers that turn planes into design constraints, and the tooling we use to calibrate the critic and verify its judgments against the engine.

- Event context: August Demo Day ft Runpod, Veris, Openrouter, — 2026-08-19 — New York City
- Public talk page: https://nyc.aitinkerers.org/talks/rsvp_G0dtIg_V-Dw

### [Converting Apple’s Sharp ML for your devices](https://raleigh.aitinkerers.org/talks/rsvp_kERNVs9PVNw)

Apple’s SHARP project uses gaussian splatting to convert regular 2D images into full 3D scenes much faster than previous models. They released the model as pytorch, but i will show how to convert it to run in a browser or in VR on a VisionPro, and use opengl techniques to extend interactivity

- Event context: AI Tinkerers Raleigh Meetup — February 11, 2026 — 2026-02-11 — Raleigh
- Public talk page: https://raleigh.aitinkerers.org/talks/rsvp_kERNVs9PVNw

### [Audio Mixing in AR](https://seattle.aitinkerers.org/talks/rsvp_bH_pZ1D38J8)

Augmented reality (AR) interface for spatial audio manipulation deployed on Apple Vision Pro.

- Event context: Friday - AI Tinkerers Seattle - May Meetup — 2025-05-31 — Seattle
- Public talk page: https://seattle.aitinkerers.org/talks/rsvp_bH_pZ1D38J8

## Related Technologies

- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) — 662 public demos
- [VisionOS](https://aitinkerers.org/technologies/visionos) ([Markdown](https://aitinkerers.org/technologies/visionos.md)) — 3 public demos
- [Apple Vision Pro](https://aitinkerers.org/technologies/apple-vision-pro) ([Markdown](https://aitinkerers.org/technologies/apple-vision-pro.md)) — 3 public demos
- [C#](https://aitinkerers.org/technologies/c-3) ([Markdown](https://aitinkerers.org/technologies/c-3.md)) — 9 public demos
- [Dashboards](https://aitinkerers.org/technologies/dashboards) ([Markdown](https://aitinkerers.org/technologies/dashboards.md)) — 2 public demos
- [Flutter](https://aitinkerers.org/technologies/flutter) ([Markdown](https://aitinkerers.org/technologies/flutter.md)) — 24 public demos
- [LiDAR](https://aitinkerers.org/technologies/lidar) ([Markdown](https://aitinkerers.org/technologies/lidar.md)) — 6 public demos
- [metal shaders](https://aitinkerers.org/technologies/metal-shaders) ([Markdown](https://aitinkerers.org/technologies/metal-shaders.md)) — 1 public demo
- [ONNX](https://aitinkerers.org/technologies/onnx) ([Markdown](https://aitinkerers.org/technologies/onnx.md)) — 83 public demos
- [PyTorch](https://aitinkerers.org/technologies/pytorch) ([Markdown](https://aitinkerers.org/technologies/pytorch.md)) — 273 public demos
- [RoomPlan](https://aitinkerers.org/technologies/roomplan) ([Markdown](https://aitinkerers.org/technologies/roomplan.md)) — 1 public demo
- [Streamlit](https://aitinkerers.org/technologies/streamlit) ([Markdown](https://aitinkerers.org/technologies/streamlit.md)) — 89 public demos
- [Swift](https://aitinkerers.org/technologies/swift) ([Markdown](https://aitinkerers.org/technologies/swift.md)) — 17 public demos
- [Unity3D](https://aitinkerers.org/technologies/unity3d) ([Markdown](https://aitinkerers.org/technologies/unity3d.md)) — 1 public demo
- [WebGL](https://aitinkerers.org/technologies/webgl) ([Markdown](https://aitinkerers.org/technologies/webgl.md)) — 3 public demos