Training BERT Language Model From Scratch On TPUs

Save to stack
Abhishek Thakur Open on YouTube ↗
Course Format Students Audience Intermediate Level BERT Technique TPU Tool
From the creator

In this video I show how you can train your own language model e.g. BERT or any other configuration from scratch on Google's TPUs. Kaggle recently incorporated v3-8 TPUs in their Kernels/Notebooks and I will be using those. The Kernel is available here: https://www.kaggle.com/abhishek/training-language-models-on-tpus-from-scratch Follow me on: Twitter: https://twitter.com/abhi1thakur LinkedIn: https://www.linkedin.com/in/abhi1thakur/ Kaggle: https://kaggle.com/abhishek

Stop watching · start building
Matched to Course

Makers residency 4th edition

Your idea can be anything. At our last workshops, people built plant-based nutrition businesses, a way to measure planetary resilience, crochet headwear and a way to connect lonely people living in the same building. An asset manager went on to raise an additional £25M on their fund within nine months. The fourth workshop is a full day at KOKO with Nick Sarafa, learning to build with Claude Code. Bring the thing you keep meaning to start. We’ll bring the pizza.

◆ Fri 13 Nov 2026 ◆ KOKO, London
Get tickets See every event
Makers residency 4th edition
Live event
Makers residency 4th edition
Fri 13 Nov 2026
Find a job · 6 live roles

Jobs in AI.
Apply now.

Apply once › get screened › meet the company

See all roles

More like this

Running one yourself?

List your AI event,
wherever it is.

A meetup, a workshop, a hackathon, a conference. Any city, or online. Tell us about it and it lands in front of people already learning this stuff.

List your AI event