# Evaluations Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/evaluations
> Markdown URL: https://aitinkerers.org/technologies/evaluations.md
> Technology record last updated: 2026-03-25T12:19:46Z
> Generated: 2026-10-24T07:59:33Z

DeepEval is the open-source LLM evaluation framework: it functions as a Pytest-like unit testing tool for validating large language model outputs with programmatic rigor.

Evaluations, specifically via the DeepEval framework, provide the necessary structure for systematic LLM testing. This open-source tool integrates directly into your CI/CD pipeline, acting like a specialized Pytest for AI applications. It leverages over 50 research-backed metrics—including G-Eval, RAGAS, and Hallucination checks—to score model performance on specific criteria. Developers define test cases, run the evaluation, and receive concrete metrics to prevent regressions, ensuring model reliability before deployment.

- Official technology site: https://deepeval.com/
- Public AI Tinkerers demos and talks: 3
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Finding problems with your agents in production](https://montreal.aitinkerers.org/talks/rsvp_B5uOVF3D5dE)

- Event context: AI Tinkerers Montreal - June Demo Meetup — 2026-06-17 — Montreal
- Public talk page: https://montreal.aitinkerers.org/talks/rsvp_B5uOVF3D5dE

### [Overview of Generative AI on Google Cloud](https://austin.aitinkerers.org/talks/rsvp_euUdOyeCJHU)

- Event context: AI Tinkerers Austin Demo Night — November 10, 2025 — 2025-11-10 — Austin
- Public talk page: https://austin.aitinkerers.org/talks/rsvp_euUdOyeCJHU

### [elluminate](https://paris.aitinkerers.org/talks/rsvp_uDUj04o6Hs0)

- Event context: AI Tinkerers - Paris Inaugural Meetup featuring Mistral AI — 2024-09-03 — Paris
- Public talk page: https://paris.aitinkerers.org/talks/rsvp_uDUj04o6Hs0

## Related Technologies

- [ADK](https://aitinkerers.org/technologies/adk) ([Markdown](https://aitinkerers.org/technologies/adk.md)) — 5 public demos
- [Agent Engine](https://aitinkerers.org/technologies/agent-engine) ([Markdown](https://aitinkerers.org/technologies/agent-engine.md)) — 3 public demos
- [Elluminate](https://aitinkerers.org/technologies/elluminate) ([Markdown](https://aitinkerers.org/technologies/elluminate.md)) — 4 public demos
- [Explainability](https://aitinkerers.org/technologies/explainability) ([Markdown](https://aitinkerers.org/technologies/explainability.md)) — 1 public demo
- [Gemini](https://aitinkerers.org/technologies/gemini) ([Markdown](https://aitinkerers.org/technologies/gemini.md)) — 189 public demos
- [GenMedia](https://aitinkerers.org/technologies/genmedia) ([Markdown](https://aitinkerers.org/technologies/genmedia.md)) — 1 public demo
- [LLM](https://aitinkerers.org/technologies/llm) ([Markdown](https://aitinkerers.org/technologies/llm.md)) — 123 public demos
- [MCP](https://aitinkerers.org/technologies/mcp) ([Markdown](https://aitinkerers.org/technologies/mcp.md)) — 142 public demos
- [PostHog AI Observability](https://aitinkerers.org/technologies/posthog-ai-observability) ([Markdown](https://aitinkerers.org/technologies/posthog-ai-observability.md)) — 1 public demo
- [PostHog Evaluations](https://aitinkerers.org/technologies/posthog-evaluations) ([Markdown](https://aitinkerers.org/technologies/posthog-evaluations.md)) — 1 public demo
- [PostHog's AI Observability](https://aitinkerers.org/technologies/posthog-s-ai-observability) ([Markdown](https://aitinkerers.org/technologies/posthog-s-ai-observability.md)) — 1 public demo
- [Prompt Management](https://aitinkerers.org/technologies/prompt-management) ([Markdown](https://aitinkerers.org/technologies/prompt-management.md)) — 1 public demo
- [Self-Driving Inbox](https://aitinkerers.org/technologies/self-driving-inbox) ([Markdown](https://aitinkerers.org/technologies/self-driving-inbox.md)) — 1 public demo