# BERT models Projects at AI Tinkerers

> Canonical HTML: https://aitinkerers.org/technologies/bert-models
> Markdown URL: https://aitinkerers.org/technologies/bert-models.md
> Technology record last updated: 2026-02-25T21:48:37Z
> Generated: 2026-08-24T08:45:32Z

BERT (Bidirectional Encoder Representations from Transformers) is the deep, bidirectional Transformer model that set a new state-of-the-art standard for natural language processing (NLP) tasks.

BERT (Bidirectional Encoder Representations from Transformers) is the influential language model released by Google AI in 2018. Its core technical innovation is the use of a deep, *bidirectional* training approach—specifically, Masked Language Modeling (MLM)—which allows it to learn context from both the left and right sides of a word simultaneously (unlike previous models). Built on the encoder-only Transformer architecture, BERT was pre-trained on massive text corpora (like the 800M word BookCorpus and 2,500M word Wikipedia) in two main sizes: BERT-Base (110 million parameters) and BERT-Large (340 million parameters). This pre-training enables efficient fine-tuning for a wide array of downstream NLP applications, including question answering (SQuAD), sentiment analysis, and named entity recognition.

- Official technology site: https://github.com/google-research/bert
- Public AI Tinkerers demos and talks: 1
- Result page: 1 of 1

## Recent Public Talks and Demos

### [Google Meet with Live Profanity Detection](https://montreal.aitinkerers.org/talks/rsvp_5OJ9pjBGnPI)

It's straight forward, I created a Google Meet clone to add live transcription and profanity detection. Everything runs on CPU.. Frontend, Backend, AI models training, Inference, or data cleaning.. I have everything

- Event context: AI Tinkerers Montreal - March 2025 Meetup at Shopify — 2025-03-12 — Montreal
- Public talk page: https://montreal.aitinkerers.org/talks/rsvp_5OJ9pjBGnPI

## Related Technologies

- [Go](https://aitinkerers.org/technologies/go) ([Markdown](https://aitinkerers.org/technologies/go.md)) — 24 public demos
- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) — 654 public demos
- [Sherpa-onnx](https://aitinkerers.org/technologies/sherpa-onnx) ([Markdown](https://aitinkerers.org/technologies/sherpa-onnx.md)) — 1 public demo
- [Traefik](https://aitinkerers.org/technologies/traefik) ([Markdown](https://aitinkerers.org/technologies/traefik.md)) — 1 public demo