# BERT Projects at AI Tinkerers
> Canonical HTML: https://aitinkerers.org/technologies/bert?page=8
> Markdown URL: https://aitinkerers.org/technologies/bert.md?page=8
> Technology record last updated: 2026-02-24T08:39:03Z
> Generated: 2026-08-26T21:23:29Z
BERT (Bidirectional Encoder Representations from Transformers) is a foundational, pre-trained NLP model that uses a Transformer encoder to process text bidirectionally, capturing full word context for superior language understanding.
BERT is a revolutionary language representation model introduced by Google AI Language in 2018. It is built on the Transformer architecture and distinguishes itself by being deeply bidirectional: it processes the entire sequence of words (left and right context) simultaneously, unlike previous unidirectional models. This capability is achieved through a Masked Language Model (MLM) pre-training objective. The model, released in sizes like BERTBASE (110 million parameters) and BERTLARGE (340 million parameters), dramatically improved the state-of-the-art across 11+ Natural Language Processing tasks, including question answering (SQuAD) and sentiment analysis, establishing a new baseline for the field.
- Official technology site: https://arxiv.org/abs/1810.04805
- Public AI Tinkerers demos and talks: 179
- Result page: 8 of 8
## Recent Public Talks and Demos
### [Teammate](https://sf.aitinkerers.org/talks/rsvp_77lDjYqH1b0)
An AI powered time assistant for anyone with a manager schedule
- Event context: π€ππ§ AI Tinkerers SF - October Meetup β 2023-10-26 β San Francisco
- Public talk page: https://sf.aitinkerers.org/talks/rsvp_77lDjYqH1b0
### [Retrieval Augmented Generation Crash Course](https://slc.aitinkerers.org/talks/rsvp_B6Jt_G0R0RU)
explanation on vectorDBs and RAG methodology
- Event context: AI Tinkerers - Salt Lake City: Meetup Part Deux β 2023-10-04 β Salt Lake City
- Public talk page: https://slc.aitinkerers.org/talks/rsvp_B6Jt_G0R0RU
### [Napkinmatic 3D Photo to XR Mode (post SIGGRAPH Edition)](https://sf.aitinkerers.org/talks/rsvp_56tYxr95PKo)
We take a photo of the audience (or those who want to be converted) and turn that into a bunch of 3D augmented reality (or XR) talking heads, actual 3D mesh gen.
- Event context: AI Tinkerers SF - September Meetupπ€ππ§ β 2023-09-22 β San Francisco
- Public talk page: https://sf.aitinkerers.org/talks/rsvp_56tYxr95PKo
### [Making pull request less painful](https://london.aitinkerers.org/talks/rsvp_eX_viG5SdJY)
How can we exploit AI to efficiently create and review pull requests
- Event context: AI Tinkerers London - September Meetup β 2023-09-13 β London
- Public talk page: https://london.aitinkerers.org/talks/rsvp_eX_viG5SdJY
### [Glimpse Insights Demo](https://la.aitinkerers.org/talks/rsvp_T7Yb27kxPgI)
Glimpse ingests data from everywhere you talk to customers: call transcripts, emails, and more. Companies define questions they want to track, and those results are auto-populated and exported to all your critical SaaS apps. We also provide an interface for ad-hoc queries if you want to dig deeper on a particular company or trend.
- Event context: Innaugural AI Tinkerers LA - Aug 17 β 2023-08-18 β Los Angeles
- Public talk page: https://la.aitinkerers.org/talks/rsvp_T7Yb27kxPgI
### [ML Generated Docs through Video Understanding](https://seattle.aitinkerers.org/talks/rsvp_Rd7nRlt5Gbs)
At Augmend we're developing ways to capture knowledge when devs work. We recently began experimenting with a new feature where we are able to auto-generate documentation just from "watching" your workflow. This allows for things like creating markdown for a how-to wiki without actually having to write anything or capturing the steps you took to solve a problem without taking notes yourself.
- Event context: AI Tinkerers Seattle - August Meetup β 2023-08-09 β Seattle
- Public talk page: https://seattle.aitinkerers.org/talks/rsvp_Rd7nRlt5Gbs
### [Generative UI: Using LLMs to Build Dynamic UI at Runtime](https://seattle.aitinkerers.org/talks/rsvp_KQgxuBn8zPQ)
Demonstrate how the UI can be built dynamically at runtime by the LLM based on the user's query/needs.
- Event context: AI Tinkerers Seattle - August Meetup β 2023-08-09 β Seattle
- Public talk page: https://seattle.aitinkerers.org/talks/rsvp_KQgxuBn8zPQ
### [Using LLMs for real-world robot control](https://seattle.aitinkerers.org/talks/rsvp_1NeMpAenb2Y)
Welcome our robot overlords, controlled by ChatGPT. See how LLMs can be used to control a ground robot, with the right prompting and OpenAI's function calling feature.
- Event context: AI Tinkerers Seattle - August Meetup β 2023-08-09 β Seattle
- Public talk page: https://seattle.aitinkerers.org/talks/rsvp_1NeMpAenb2Y
### [Red teaming ideas: using LLM's to think through investment decisions](https://nyc.aitinkerers.org/talks/rsvp_BzPTrN3kyHo)
Can we go a step beyond summarization and create a platform to generate arguments to challenge our investment ideas? We built a fun and thought provoking demo for use in one of NYC's largest hedge funds
- Event context: AI Tinkerers NYC Inaugural Meetup - August β 2023-08-01 β New York City
- Public talk page: https://nyc.aitinkerers.org/talks/rsvp_BzPTrN3kyHo
### [Security & Compliance w/AI](https://seattle.aitinkerers.org/talks/rsvp_R1G41BCVT1I)
The lowest hanging and high ROI problem to solve with LLMs is compliance and security baseline automations. With this bot, I intend to enable engineers and operators to meet minimum required security standards for their environments in various sectors(industrial controls, finance, manufacturing, energy, etc.) Utilizing public memos from CISA and the Department of Homeland Security, we ingest and triage known exploits and vulnerabilities (think log4j) to inform our engineers & operators on the highest ROI issues to address.
- Event context: AI Tinkerers Seattle - July Meetup β 2023-07-27 β Seattle
- Public talk page: https://seattle.aitinkerers.org/talks/rsvp_R1G41BCVT1I
### [Skyglass](https://denver-boulder.aitinkerers.org/talks/rsvp_XK4pspNGti8)
Skyglass is a virtual production app for iPhone. It takes the real-time VFX tech that has taken Hollywood by storm since The Mandalorian and puts it in the hands of every creator.
- Event context: July Meetup β 2023-07-19 β Denver
- Public talk page: https://denver-boulder.aitinkerers.org/talks/rsvp_XK4pspNGti8
## Related Technologies
- [GPT-3](https://aitinkerers.org/technologies/gpt-3) ([Markdown](https://aitinkerers.org/technologies/gpt-3.md)) β 191 public demos
- [GPT-4](https://aitinkerers.org/technologies/gpt-4) ([Markdown](https://aitinkerers.org/technologies/gpt-4.md)) β 529 public demos
- [RoBERTa](https://aitinkerers.org/technologies/roberta) ([Markdown](https://aitinkerers.org/technologies/roberta.md)) β 118 public demos
- [BLOOM](https://aitinkerers.org/technologies/bloom) ([Markdown](https://aitinkerers.org/technologies/bloom.md)) β 115 public demos
- [Llama-2](https://aitinkerers.org/technologies/llama-2) ([Markdown](https://aitinkerers.org/technologies/llama-2.md)) β 227 public demos
- [PaLM 2](https://aitinkerers.org/technologies/palm-2) ([Markdown](https://aitinkerers.org/technologies/palm-2.md)) β 116 public demos
- [PyTorch](https://aitinkerers.org/technologies/pytorch) ([Markdown](https://aitinkerers.org/technologies/pytorch.md)) β 273 public demos
- [scikit-learn](https://aitinkerers.org/technologies/scikit-learn) ([Markdown](https://aitinkerers.org/technologies/scikit-learn.md)) β 83 public demos
- [TensorFlow](https://aitinkerers.org/technologies/tensorflow) ([Markdown](https://aitinkerers.org/technologies/tensorflow.md)) β 90 public demos
- [Keras](https://aitinkerers.org/technologies/keras) ([Markdown](https://aitinkerers.org/technologies/keras.md)) β 74 public demos
- [ONNX](https://aitinkerers.org/technologies/onnx) ([Markdown](https://aitinkerers.org/technologies/onnx.md)) β 83 public demos
- [RAG](https://aitinkerers.org/technologies/rag) ([Markdown](https://aitinkerers.org/technologies/rag.md)) β 147 public demos
- [Python](https://aitinkerers.org/technologies/python) ([Markdown](https://aitinkerers.org/technologies/python.md)) β 654 public demos
- [Generative AI](https://aitinkerers.org/technologies/generative-ai) ([Markdown](https://aitinkerers.org/technologies/generative-ai.md)) β 45 public demos
- [Machine Learning](https://aitinkerers.org/technologies/machine-learning) ([Markdown](https://aitinkerers.org/technologies/machine-learning.md)) β 20 public demos
- [Large Language Models](https://aitinkerers.org/technologies/large-language-models) ([Markdown](https://aitinkerers.org/technologies/large-language-models.md)) β 8 public demos
- [Prompt Engineering](https://aitinkerers.org/technologies/prompt-engineering) ([Markdown](https://aitinkerers.org/technologies/prompt-engineering.md)) β 28 public demos
- [AI agents](https://aitinkerers.org/technologies/ai-agents) ([Markdown](https://aitinkerers.org/technologies/ai-agents.md)) β 35 public demos
## More Results
- Previous: https://aitinkerers.org/technologies/bert.md?page=7