# Human-in-the-Loop Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/human-in-the-loop
> Markdown URL: https://aitinkerers.org/technologies/human-in-the-loop.md
> Technology record last updated: 2026-02-26T21:01:06Z
> Generated: 2026-09-22T19:41:43Z

Human-in-the-Loop (HITL) is the critical AI workflow: it embeds human judgment into the machine learning lifecycle to ensure accuracy, accountability, and continuous model improvement.

HITL is a strategic system design, integrating human expertise directly into AI/ML processes. This is not optional; it’s the mechanism for achieving high-stakes reliability. Humans execute three core functions: data annotation (labeling thousands of invoices for initial training), model evaluation (validating low-confidence predictions), and real-time correction. For example, a radiologist reviews a medical imaging scan flagged by an AI for a potential tumor, ensuring diagnostic accuracy hits the 96–98% range. This continuous feedback loop leverages AI’s speed with human nuance, mitigating bias and handling complex edge cases automation alone cannot resolve.

- Official technology site: https://www.ibm.com/topics/human-in-the-loop
- Public AI Tinkerers demos and talks: 6
- Result page: 1 of 1

## Recent Public Talks and Demos

### [What aviation safety teaches us about human-in-the-loop](https://orange-county.aitinkerers.org/talks/rsvp_WHC6Ea08Nhg)

Abstract: When an agentic automation can't go all the way or needs help, we've become used to falling back on "human-in-the-loop". We've all been through the journey of hitting Enter on agent permissions to giving in and running in YOLO mode. However, there is a deep literature that looks at exactly this problem of humans and automation interplaying. There is also a painful history of aviation disasters involving cockpit automation. These can be helpful when undersrtanding the current agent/human design problem.

- Event context: AI Tinkerers OC - August 19th, 2026 Meetup @ Ingram Micro — 2026-08-20 — Orange County
- Public talk page: https://orange-county.aitinkerers.org/talks/rsvp_WHC6Ea08Nhg

### [Bmg usa IA para análise e padronização de documentos em larga escala, e atende órgão regulador.](https://saopaulo.aitinkerers.org/talks/rsvp_PNWm4hcTjqE)

O projeto é um agente de Inteligência Artificial desenvolvido para automatizar a análise, organização e padronização massiva de documentos de seguros: - O contexto prático da aplicação envolveu a necessidade urgente do Banco Bmg (BMG Seguradora) de processar e validar aproximadamente 6 anos de histórico de dossiês para atender a uma exigência de um órgão regulador, uma tarefa de escala tão grande que tornava o cumprimento do prazo inviável por vias puramente manuais

- Event context: AI Tinkerers SP e Banco BMG — 2026-03-26 — São Paulo
- Public talk page: https://saopaulo.aitinkerers.org/talks/rsvp_PNWm4hcTjqE

### [Designing AI Workflows with Human in the Loop](https://amsterdam.aitinkerers.org/talks/rsvp_lvlJdO0AAVI)

I’m interested in sharing my experiments as a Creative Technologist, particularly in designing "AI Workflows with Humans in the Loop". I’d love to share some of my prior Creative Concept Designs. I guess the overarching theme would be: “AI shines as a collaborative tool that amplifies human creativity. Its true potential emerges when humans remain at the center, bringing their unique visions and experiences to the process.

- Event context: AI Tinkerers Amsterdam - April Edition — 2025-04-02 — Amsterdam
- Public talk page: https://amsterdam.aitinkerers.org/talks/rsvp_lvlJdO0AAVI

### [The War Room: a shared workspace for specialists to handle events](https://nyc.aitinkerers.org/talks/rsvp_nwotolIL-TQ)

The same characteristics of a "War Room" that allow military industry companies to bring all-hands-on-deck and solve critical issues can be applied to pull together multiple LLM agents to work on a shared topic. It involves realtime events, processed by specialized agents, whose output is captured in a shared workspace. This offers a system for human-in-the-loop selection of actions proposed by specialized agents that are fully aware of the context. Demonstrated in the new contextFound prototype for personal information organization.

- Event context: AI Tinkerers - New York City - December 2024 Meetup — 2024-12-12 — New York City
- Public talk page: https://nyc.aitinkerers.org/talks/rsvp_nwotolIL-TQ

### [Notorious R.A.G - A coding helper Discord Bot w/ Human in the loop](https://seattle.aitinkerers.org/talks/rsvp_wwIhkKR7aK0)

We made an opensource Bot that can leverage humans to provide hyper accurate code snippets in discord using memory. AI Bots are great, but they often make a lot of mistakes. We can't trust them to run wild. I'll demo how Notorious R.A.G. that can answer very specific coding questions with an agentic RAG flow, look up its past information, and even knows how to ask a human for advice before moving forward with the reply.

- Event context: AI Tinkerers - Seattle - October 2024 Meetup — 2024-10-25 — Seattle
- Public talk page: https://seattle.aitinkerers.org/talks/rsvp_wwIhkKR7aK0

### [Lindy – Build full-fledged AI agents in no-code](https://sf.aitinkerers.org/talks/rsvp_O6XN5nrAZrM)

We're about to release Lindy 2.0, a major rewrite of Lindy, and are demo'ing it publicly for the first time at AI tinkerers. Lindy lets you build your own AI agents in no-code in minutes — you can create extremely powerful agents talking to hundreds of APIs, conversing with users across multiple channels, keeping a human in the loop etc… in literally < 5 min.

- Event context: AI Tinkerers - San Francisco - August 2024 Meetup — 2024-08-22 — San Francisco
- Public talk page: https://sf.aitinkerers.org/talks/rsvp_O6XN5nrAZrM

## Related Technologies

- [Agentic automation](https://aitinkerers.org/technologies/agentic-automation) ([Markdown](https://aitinkerers.org/technologies/agentic-automation.md)) — 1 public demo
- [AI agents](https://aitinkerers.org/technologies/ai-agents) ([Markdown](https://aitinkerers.org/technologies/ai-agents.md)) — 35 public demos
- [AI Workflow](https://aitinkerers.org/technologies/ai-workflow) ([Markdown](https://aitinkerers.org/technologies/ai-workflow.md)) — 1 public demo
- [Amazon Bedrock](https://aitinkerers.org/technologies/amazon-bedrock) ([Markdown](https://aitinkerers.org/technologies/amazon-bedrock.md)) — 20 public demos
- [Amazon Kinesis](https://aitinkerers.org/technologies/amazon-kinesis) ([Markdown](https://aitinkerers.org/technologies/amazon-kinesis.md)) — 5 public demos
- [Apache Beam](https://aitinkerers.org/technologies/apache-beam) ([Markdown](https://aitinkerers.org/technologies/apache-beam.md)) — 1 public demo
- [Apache Flink](https://aitinkerers.org/technologies/apache-flink) ([Markdown](https://aitinkerers.org/technologies/apache-flink.md)) — 4 public demos
- [Apache Kafka](https://aitinkerers.org/technologies/apache-kafka) ([Markdown](https://aitinkerers.org/technologies/apache-kafka.md)) — 8 public demos
- [Apache Storm](https://aitinkerers.org/technologies/apache-storm) ([Markdown](https://aitinkerers.org/technologies/apache-storm.md)) — 2 public demos
- [APIs](https://aitinkerers.org/technologies/apis) ([Markdown](https://aitinkerers.org/technologies/apis.md)) — 19 public demos
- [Aviation safety literature](https://aitinkerers.org/technologies/aviation-safety-literature) ([Markdown](https://aitinkerers.org/technologies/aviation-safety-literature.md)) — 1 public demo
- [AWS](https://aitinkerers.org/technologies/aws) ([Markdown](https://aitinkerers.org/technologies/aws.md)) — 38 public demos
- [Batch (AWS)](https://aitinkerers.org/technologies/batch-aws) ([Markdown](https://aitinkerers.org/technologies/batch-aws.md)) — 1 public demo
- [contextFound](https://aitinkerers.org/technologies/contextfound) ([Markdown](https://aitinkerers.org/technologies/contextfound.md)) — 2 public demos
- [Data Visualization](https://aitinkerers.org/technologies/data-visualization) ([Markdown](https://aitinkerers.org/technologies/data-visualization.md)) — 3 public demos
- [Discord](https://aitinkerers.org/technologies/discord) ([Markdown](https://aitinkerers.org/technologies/discord.md)) — 10 public demos
- [Google Cloud Dataflow](https://aitinkerers.org/technologies/google-cloud-dataflow) ([Markdown](https://aitinkerers.org/technologies/google-cloud-dataflow.md)) — 2 public demos
- [Lindy](https://aitinkerers.org/technologies/lindy) ([Markdown](https://aitinkerers.org/technologies/lindy.md)) — 1 public demo