# SWE-Bench Verified Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/swe-bench-verified
> Markdown URL: https://aitinkerers.org/technologies/swe-bench-verified.md
> Technology record last updated: 2026-09-18T15:13:41Z
> Generated: 2026-09-20T17:36:06Z

SWE-bench Verified is a human-validated coding benchmark of 500 real-world GitHub issues designed to reliably test AI agents on software engineering tasks.

Developed in collaboration with OpenAI's Preparedness team, SWE-bench Verified isolates a high-fidelity subset of 500 tasks from the original SWE-bench dataset. Human annotators manually vetted each instance to guarantee clear problem descriptions, correct test patches, and solvable tasks (eliminating the noisy, underspecified, or overly specific unit tests that plague automated benchmarks). By focusing on 500 verified issue-pull request pairs across popular Python repositories, it serves as a rigorous, containerized standard for evaluating how effectively LLMs and AI coding agents can resolve actual software engineering bugs.

- Official technology site: https://www.swebench.com
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Meet North Mini Code: Cohere's first model for developers.](https://montreal.aitinkerers.org/talks/rsvp_RFfBetDE0zk)

North Mini Code is a 30B parameter MoE coding model (3B active) that Cohere released June 9 under Apache 2.0, trained specifically for agentic software engineering. We will demo it live in OpenCode so you can watch it work through an agentic coding task end to end. Alongside the live agent session, we'll walk through the architecture and the post-training pipeline that got it there: two stages of SFT followed by async RLVR across terminal and SWE environments.

- Event context: AI Tinkerers Montreal - June Demo Meetup — 2026-06-17 — Montreal
- Public talk page: https://montreal.aitinkerers.org/talks/rsvp_RFfBetDE0zk

## Related Technologies

- [Agent harness](https://aitinkerers.org/technologies/agent-harness) ([Markdown](https://aitinkerers.org/technologies/agent-harness.md)) — 1 public demo
- [Harbor](https://aitinkerers.org/technologies/harbor) ([Markdown](https://aitinkerers.org/technologies/harbor.md)) — 2 public demos
- [Hugging Face](https://aitinkerers.org/technologies/hugging-face) ([Markdown](https://aitinkerers.org/technologies/hugging-face.md)) — 41 public demos
- [Live Demo](https://aitinkerers.org/technologies/live-demo) ([Markdown](https://aitinkerers.org/technologies/live-demo.md)) — 1 public demo
- [mini-SWE-agent](https://aitinkerers.org/technologies/mini-swe-agent) ([Markdown](https://aitinkerers.org/technologies/mini-swe-agent.md)) — 1 public demo
- [MoE](https://aitinkerers.org/technologies/moe) ([Markdown](https://aitinkerers.org/technologies/moe.md)) — 1 public demo
- [North Mini Code](https://aitinkerers.org/technologies/north-mini-code) ([Markdown](https://aitinkerers.org/technologies/north-mini-code.md)) — 1 public demo
- [North Mini Code (30B MoE, 3B active)](https://aitinkerers.org/technologies/north-mini-code-30b-moe-3b-active) ([Markdown](https://aitinkerers.org/technologies/north-mini-code-30b-moe-3b-active.md)) — 1 public demo
- [OpenCode](https://aitinkerers.org/technologies/opencode) ([Markdown](https://aitinkerers.org/technologies/opencode.md)) — 12 public demos
- [SWE-agent](https://aitinkerers.org/technologies/swe-agent) ([Markdown](https://aitinkerers.org/technologies/swe-agent.md)) — 1 public demo
- [Terminal-Bench v2](https://aitinkerers.org/technologies/terminal-bench-v2) ([Markdown](https://aitinkerers.org/technologies/terminal-bench-v2.md)) — 1 public demo
- [vLLM](https://aitinkerers.org/technologies/vllm) ([Markdown](https://aitinkerers.org/technologies/vllm.md)) — 33 public demos