Training BERT Language Model From Scratch On TPUs

Save to stack
Abhishek Thakur Open on YouTube ↗
Course Format Students Audience Intermediate Level BERT Technique TPU Tool
From the creator

In this video I show how you can train your own language model e.g. BERT or any other configuration from scratch on Google's TPUs. Kaggle recently incorporated v3-8 TPUs in their Kernels/Notebooks and I will be using those. The Kernel is available here: https://www.kaggle.com/abhishek/training-language-models-on-tpus-from-scratch Follow me on: Twitter: https://twitter.com/abhi1thakur LinkedIn: https://www.linkedin.com/in/abhi1thakur/ Kaggle: https://kaggle.com/abhishek

Choose to Build with AI
Matched to Course

AI Maker Residence 3

The third AI workshop taught by our legendary teacher, Nick Sarafa. This is a full-day hands-on training workshop for purposeful co-creation with AI using Claude Code. Imagine having access to hundreds of billions of dollars of computing power and knowing exactly how to make it work for you through the power of super intelligence.

◆ Fri 09 Oct 2026 ◆ KOKO Cafe, London ◆ With Nick Sarafa
Get your seat See every event
AI Maker Residence 3
Live event
AI Maker Residence 3
Fri 09 Oct 2026

More like this

Running one yourself?

List your AI event,
wherever it is.

A meetup, a workshop, a hackathon, a conference. Any city, or online. Tell us about it and it lands in front of people already learning this stuff.

List your AI event