# DeepEval Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/deepeval
> Markdown URL: https://aitinkerers.org/technologies/deepeval.md
> Technology record last updated: 2026-02-23T21:05:34Z
> Generated: 2026-10-25T12:54:36Z

DeepEval is the open-source LLM evaluation framework: unit-test your AI applications with 30+ research-backed metrics, ensuring reliability from development to production.

DeepEval is your open-source LLM evaluation framework, designed for engineering teams. It lets you 'unit test' LLM outputs (similar to Pytest), ensuring reliability for RAG, agents, and chatbots. Leverage 30+ LLM-evaluated metrics—like Hallucination and Answer Relevancy—and custom G-Eval to rigorously benchmark performance. DeepEval supports both end-to-end and component-level tracing, integrating directly into CI/CD pipelines to prevent regressions and accelerate confident deployment. The companion Confident AI cloud platform centralizes results and debugging.

- Official technology site: https://confident-ai.com
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [A Noob's Account of Learning about Basic Agent Testing with Deep Eval](https://liverpool.aitinkerers.org/talks/rsvp_eHZqu3Yif7Q)

- Event context: AI Tinkerers - Liverpool Inaugural Meetup (June) — 2025-06-26 — Liverpool
- Public talk page: https://liverpool.aitinkerers.org/talks/rsvp_eHZqu3Yif7Q

## Related Technologies

- [Anthropic API](https://aitinkerers.org/technologies/anthropic-api) ([Markdown](https://aitinkerers.org/technologies/anthropic-api.md)) — 66 public demos
- [instructor](https://aitinkerers.org/technologies/instructor) ([Markdown](https://aitinkerers.org/technologies/instructor.md)) — 3 public demos
- [Jupyter notebooks](https://aitinkerers.org/technologies/jupyter-notebooks) ([Markdown](https://aitinkerers.org/technologies/jupyter-notebooks.md)) — 4 public demos
- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) — 686 public demos