# BERT Projects at AI Tinkerers
> Canonical HTML: https://aitinkerers.org/technologies/bert
> Markdown URL: https://aitinkerers.org/technologies/bert.md
> Technology record last updated: 2026-02-24T08:39:03Z
> Generated: 2026-10-25T06:15:47Z
BERT (Bidirectional Encoder Representations from Transformers) is a foundational, pre-trained NLP model that uses a Transformer encoder to process text bidirectionally, capturing full word context for superior language understanding.
BERT is a revolutionary language representation model introduced by Google AI Language in 2018. It is built on the Transformer architecture and distinguishes itself by being deeply bidirectional: it processes the entire sequence of words (left and right context) simultaneously, unlike previous unidirectional models. This capability is achieved through a Masked Language Model (MLM) pre-training objective. The model, released in sizes like BERTBASE (110 million parameters) and BERTLARGE (340 million parameters), dramatically improved the state-of-the-art across 11+ Natural Language Processing tasks, including question answering (SQuAD) and sentiment analysis, establishing a new baseline for the field.
- Official technology site: https://arxiv.org/abs/1810.04805
- Public AI Tinkerers demos and talks: 179
- Result page: 1 of 1
## Recent Public Talks and Demos
### [Self-Improving Agents with Honcho](https://nyc.aitinkerers.org/talks/rsvp_u3mcI_u6ioA)
- Event context: π¦Demo Night: OpenClaw ft Convex β 2026-02-17 β New York City
- Public talk page: https://nyc.aitinkerers.org/talks/rsvp_u3mcI_u6ioA
### [Stop Cloud Waste: AI Checks Costs Before Deploy in AWS](https://raleigh.aitinkerers.org/talks/rsvp_MX33E7LzJoM)
- Event context: AI Tinkerers Raleigh Meetup β February 11, 2026 β 2026-02-11 β Raleigh
- Public talk page: https://raleigh.aitinkerers.org/talks/rsvp_MX33E7LzJoM
### [Should You Obey Your AI Reviewer?](https://belgium.aitinkerers.org/talks/rsvp_3tv20yxQ8mQ)
- Event context: AI Tinkerers Ghent Meetup - February 11 β 2026-02-11 β Belgium
- Public talk page: https://belgium.aitinkerers.org/talks/rsvp_3tv20yxQ8mQ
### [AI agents as interface layer for mobile apps](https://tiruchirappalli.aitinkerers.org/talks/rsvp_qrJiLeqgTOo)
- Event context: AI Tinkerers Trichy: January Meetup & Live Demos β 2026-01-31 β Tiruchirappalli
- Public talk page: https://tiruchirappalli.aitinkerers.org/talks/rsvp_qrJiLeqgTOo
### [AI Predictions for 2026 from AI Tinkerers](https://montreal.aitinkerers.org/talks/rsvp_iBOlQ50Yzlk)
- Event context: AI Tinkerers Montreal - January 2026 Meetup at Ateko β 2026-01-21 β Montreal
- Public talk page: https://montreal.aitinkerers.org/talks/rsvp_iBOlQ50Yzlk
### [Shifting Out: Using AI to Translate Across the Organization](https://atlanta.aitinkerers.org/talks/rsvp_ws8aA88TM4Y)
- Event context: Co-Co-Code & Cocoa: The AI Tinkerers Atlanta Holiday Meetup β 2025-12-16 β Atlanta
- Public talk page: https://atlanta.aitinkerers.org/talks/rsvp_ws8aA88TM4Y
## Related Technologies
- [GPT-3](https://aitinkerers.org/technologies/gpt-3) ([Markdown](https://aitinkerers.org/technologies/gpt-3.md)) β 191 public demos
- [GPT-4](https://aitinkerers.org/technologies/gpt-4) ([Markdown](https://aitinkerers.org/technologies/gpt-4.md)) β 529 public demos
- [RoBERTa](https://aitinkerers.org/technologies/roberta) ([Markdown](https://aitinkerers.org/technologies/roberta.md)) β 118 public demos
- [BLOOM](https://aitinkerers.org/technologies/bloom) ([Markdown](https://aitinkerers.org/technologies/bloom.md)) β 115 public demos
- [Llama-2](https://aitinkerers.org/technologies/llama-2) ([Markdown](https://aitinkerers.org/technologies/llama-2.md)) β 227 public demos
- [PaLM 2](https://aitinkerers.org/technologies/palm-2) ([Markdown](https://aitinkerers.org/technologies/palm-2.md)) β 116 public demos
- [PyTorch](https://aitinkerers.org/technologies/pytorch) ([Markdown](https://aitinkerers.org/technologies/pytorch.md)) β 274 public demos
- [scikit-learn](https://aitinkerers.org/technologies/scikit-learn) ([Markdown](https://aitinkerers.org/technologies/scikit-learn.md)) β 85 public demos
- [TensorFlow](https://aitinkerers.org/technologies/tensorflow) ([Markdown](https://aitinkerers.org/technologies/tensorflow.md)) β 90 public demos
- [Keras](https://aitinkerers.org/technologies/keras) ([Markdown](https://aitinkerers.org/technologies/keras.md)) β 74 public demos
- [ONNX](https://aitinkerers.org/technologies/onnx) ([Markdown](https://aitinkerers.org/technologies/onnx.md)) β 84 public demos
- [RAG](https://aitinkerers.org/technologies/rag) ([Markdown](https://aitinkerers.org/technologies/rag.md)) β 148 public demos
- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) β 686 public demos
- [Generative AI](https://aitinkerers.org/technologies/generative-ai) ([Markdown](https://aitinkerers.org/technologies/generative-ai.md)) β 45 public demos
- [Machine Learning](https://aitinkerers.org/technologies/machine-learning) ([Markdown](https://aitinkerers.org/technologies/machine-learning.md)) β 20 public demos
- [Large Language Models](https://aitinkerers.org/technologies/large-language-models) ([Markdown](https://aitinkerers.org/technologies/large-language-models.md)) β 8 public demos
- [Prompt Engineering](https://aitinkerers.org/technologies/prompt-engineering) ([Markdown](https://aitinkerers.org/technologies/prompt-engineering.md)) β 28 public demos
- [AI agents](https://aitinkerers.org/technologies/ai-agents) ([Markdown](https://aitinkerers.org/technologies/ai-agents.md)) β 35 public demos