# ProtGPT2 Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/protgpt2
> Markdown URL: https://aitinkerers.org/technologies/protgpt2.md
> Technology record last updated: 2026-03-19T07:00:31Z
> Generated: 2026-10-23T23:55:10Z

ProtGPT2 is an autoregressive transformer model trained on the entire UniRef50 database to generate functional, de novo protein sequences.

Developed by the Ferruz lab, ProtGPT2 leverages a GPT-2 architecture with 738 million parameters to navigate the vast protein fitness landscape. It was trained on 45 million sequences from UniRef50 (spanning the entire protein space) to learn the underlying grammar of biological polymers. The model generates 400-residue sequences in seconds that maintain natural-like secondary structure and folding patterns. Researchers use it to design novel enzymes and binders that bypass the limitations of evolutionary-bound templates: providing a high-throughput alternative to traditional directed evolution.

- Official technology site: https://huggingface.co/nferruz/ProtGPT2
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Apple Protein Vision and LLMs for Bioinformatics](https://la.aitinkerers.org/talks/rsvp_fiy7Fw_wI9s)

- Event context: June 25th - LA AI Tinkerers Meetup & Demos — 2024-06-26 — Los Angeles
- Public talk page: https://la.aitinkerers.org/talks/rsvp_fiy7Fw_wI9s

## Related Technologies

- [3D visualization](https://aitinkerers.org/technologies/3d-visualization) ([Markdown](https://aitinkerers.org/technologies/3d-visualization.md)) — 1 public demo
- [AlphaFold](https://aitinkerers.org/technologies/alphafold) ([Markdown](https://aitinkerers.org/technologies/alphafold.md)) — 1 public demo
- [Apple Vision Pro](https://aitinkerers.org/technologies/apple-vision-pro) ([Markdown](https://aitinkerers.org/technologies/apple-vision-pro.md)) — 3 public demos
- [DiffDock](https://aitinkerers.org/technologies/diffdock) ([Markdown](https://aitinkerers.org/technologies/diffdock.md)) — 1 public demo
- [ESM-1b](https://aitinkerers.org/technologies/esm-1b) ([Markdown](https://aitinkerers.org/technologies/esm-1b.md)) — 1 public demo
- [ESM-2](https://aitinkerers.org/technologies/esm-2) ([Markdown](https://aitinkerers.org/technologies/esm-2.md)) — 2 public demos
- [ProGen](https://aitinkerers.org/technologies/progen) ([Markdown](https://aitinkerers.org/technologies/progen.md)) — 1 public demo
- [ProtBERT](https://aitinkerers.org/technologies/protbert) ([Markdown](https://aitinkerers.org/technologies/protbert.md)) — 1 public demo
- [ProtBERT-BFD](https://aitinkerers.org/technologies/protbert-bfd) ([Markdown](https://aitinkerers.org/technologies/protbert-bfd.md)) — 1 public demo
- [ProtT5](https://aitinkerers.org/technologies/prott5) ([Markdown](https://aitinkerers.org/technologies/prott5.md)) — 1 public demo