# RLHF Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/rlhf
> Markdown URL: https://aitinkerers.org/technologies/rlhf.md
> Technology record last updated: 2026-03-12T14:29:19Z
> Generated: 2026-10-25T16:42:26Z

RLHF (Reinforcement Learning from Human Feedback) is a machine learning technique: it aligns an AI agent's behavior with complex human preferences using direct human judgments as a reward signal.

RLHF is the industry-standard method for fine-tuning Large Language Models (LLMs) to be helpful, harmless, and accurate. The process involves three steps: first, human evaluators rank several model outputs to a prompt; second, this preference data trains a separate 'reward model' to predict human-like scores; third, the original LLM (the policy) is optimized using a reinforcement learning algorithm (e.g., Proximal Policy Optimization or PPO) guided by the reward model's feedback. This technique was crucial for the development of models like OpenAI's InstructGPT and ChatGPT, effectively bridging the gap between raw model capability and user-expected behavior.

- Official technology site: https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback
- Public AI Tinkerers demos and talks: 4
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Apertus: SwissAI’s fully-transparent multilingual LLM](https://lausanne.aitinkerers.org/talks/rsvp_yoFNhymPd9I)

- Event context: AI Tinkerers Lausanne June 2026 Meetup — 2026-06-25 — Lausanne
- Public talk page: https://lausanne.aitinkerers.org/talks/rsvp_yoFNhymPd9I

### [Iterating on AI features](https://valencia.aitinkerers.org/talks/rsvp_WrlMEwVSia0)

- Event context: AI Tinkerers Valencia June Meetup ft. PostHog — 2026-06-16 — Valencia
- Public talk page: https://valencia.aitinkerers.org/talks/rsvp_WrlMEwVSia0

### [Building a Multimodal Multi-Agent Chatbot with Feedback Mechanism and Reinforcement Learning Loop](https://atlanta.aitinkerers.org/talks/rsvp_b782UfRe8WQ)

- Event context: AI Tinkerers Atlanta November Meetup — 2024-11-19 — Atlanta
- Public talk page: https://atlanta.aitinkerers.org/talks/rsvp_b782UfRe8WQ

### [All the Trainingz, No Codez](https://toronto.aitinkerers.org/talks/rsvp_A7iVImRMxy0)

- Event context: AI Tinkerers - Toronto - September 2024 Meetup — 2024-09-20 — Toronto
- Public talk page: https://toronto.aitinkerers.org/talks/rsvp_A7iVImRMxy0

## Related Technologies

- [AI](https://aitinkerers.org/technologies/ai) ([Markdown](https://aitinkerers.org/technologies/ai.md)) — 56 public demos
- [LLM](https://aitinkerers.org/technologies/llm) ([Markdown](https://aitinkerers.org/technologies/llm.md)) — 123 public demos
- [RAG](https://aitinkerers.org/technologies/rag) ([Markdown](https://aitinkerers.org/technologies/rag.md)) — 148 public demos
- [DPO](https://aitinkerers.org/technologies/dpo) ([Markdown](https://aitinkerers.org/technologies/dpo.md)) — 1 public demo
- [LangGraph](https://aitinkerers.org/technologies/langgraph) ([Markdown](https://aitinkerers.org/technologies/langgraph.md)) — 70 public demos
- [LoRA](https://aitinkerers.org/technologies/lora) ([Markdown](https://aitinkerers.org/technologies/lora.md)) — 17 public demos
- [NLP](https://aitinkerers.org/technologies/nlp) ([Markdown](https://aitinkerers.org/technologies/nlp.md)) — 6 public demos
- [Open source models](https://aitinkerers.org/technologies/open-source-models) ([Markdown](https://aitinkerers.org/technologies/open-source-models.md)) — 7 public demos
- [ORPO](https://aitinkerers.org/technologies/orpo) ([Markdown](https://aitinkerers.org/technologies/orpo.md)) — 1 public demo
- [PostHog](https://aitinkerers.org/technologies/posthog) ([Markdown](https://aitinkerers.org/technologies/posthog.md)) — 14 public demos
- [PPO](https://aitinkerers.org/technologies/ppo) ([Markdown](https://aitinkerers.org/technologies/ppo.md)) — 2 public demos
- [ReactJsonAgent](https://aitinkerers.org/technologies/reactjsonagent) ([Markdown](https://aitinkerers.org/technologies/reactjsonagent.md)) — 1 public demo
- [Transformer Lab](https://aitinkerers.org/technologies/transformer-lab) ([Markdown](https://aitinkerers.org/technologies/transformer-lab.md)) — 2 public demos