# ESM-1b Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/esm-1b
> Markdown URL: https://aitinkerers.org/technologies/esm-1b.md
> Technology record last updated: 2026-03-19T07:00:34Z
> Generated: 2026-09-21T00:46:40Z

Meta AI's 650-million parameter transformer model trained on 250 million protein sequences to predict structure and function from amino acid patterns.

ESM-1b represents a milestone in protein language modeling, utilizing a BERT-style architecture to master the grammar of life. Trained on the UniRef50 database, the model captures complex biological properties (such as secondary structure and thermal stability) without explicit supervision. Researchers use its high-dimensional embeddings to accelerate drug discovery and protein engineering, outperforming traditional alignment-based methods on critical benchmarks like the Critical Assessment of Structure Prediction (CASP).

- Official technology site: https://github.com/facebookresearch/esm
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Apple Protein Vision and LLMs for Bioinformatics](https://la.aitinkerers.org/talks/rsvp_fiy7Fw_wI9s)

AI driven in-silico tools like Alphafold, DiffDock, and protein language models are rapidly changing the way scientists conduct bioinformatics research, and usering in a new level of accessibility to start of the art tools in drug discovery and genomic science. The Apple Vision Protein project is an open source initiative to build a 3D visualization and orchestration system for these new cutting edge tools: https://www.youtube.com/watch?v=RiYIahSL45g The system allows for the user/scientist to inspect and interact with the proteins they are engineering/studying in high definition 3D, to explore the particular geometry of their interactions with medicine molecules, and to configure and run the cutting edge AI tools mentioned. The app is being built by a local team from the KINN community, and recently won 'most revolutionary project' at the first Apple Vision Dev con: https://www.youtube.com/watch?v=RiYIahSL45g

- Event context: June 25th - LA AI Tinkerers Meetup & Demos — 2024-06-26 — Los Angeles
- Public talk page: https://la.aitinkerers.org/talks/rsvp_fiy7Fw_wI9s

## Related Technologies

- [3D visualization](https://aitinkerers.org/technologies/3d-visualization) ([Markdown](https://aitinkerers.org/technologies/3d-visualization.md)) — 1 public demo
- [AlphaFold](https://aitinkerers.org/technologies/alphafold) ([Markdown](https://aitinkerers.org/technologies/alphafold.md)) — 1 public demo
- [Apple Vision Pro](https://aitinkerers.org/technologies/apple-vision-pro) ([Markdown](https://aitinkerers.org/technologies/apple-vision-pro.md)) — 3 public demos
- [DiffDock](https://aitinkerers.org/technologies/diffdock) ([Markdown](https://aitinkerers.org/technologies/diffdock.md)) — 1 public demo
- [ESM-2](https://aitinkerers.org/technologies/esm-2) ([Markdown](https://aitinkerers.org/technologies/esm-2.md)) — 2 public demos
- [ProGen](https://aitinkerers.org/technologies/progen) ([Markdown](https://aitinkerers.org/technologies/progen.md)) — 1 public demo
- [ProtBERT](https://aitinkerers.org/technologies/protbert) ([Markdown](https://aitinkerers.org/technologies/protbert.md)) — 1 public demo
- [ProtBERT-BFD](https://aitinkerers.org/technologies/protbert-bfd) ([Markdown](https://aitinkerers.org/technologies/protbert-bfd.md)) — 1 public demo
- [ProtGPT2](https://aitinkerers.org/technologies/protgpt2) ([Markdown](https://aitinkerers.org/technologies/protgpt2.md)) — 1 public demo
- [ProtT5](https://aitinkerers.org/technologies/prott5) ([Markdown](https://aitinkerers.org/technologies/prott5.md)) — 1 public demo