Fine-Tuning BERT for Text Classification (w/ Example Code)
π€ Your team not maximizing Claude? I run 1:1 and team AI workshops for companies doing $10M+ per year: https://aibuilder.academy/yt/4QHg8Ix8WWQ In this video, I walk through how to fine-tune BERT (110M parameters) to classify phishing URLs. I first cover key concepts and then share example Python code. Resources: π° Blog: https://medium.com/towards-data-science/fine-tuning-bert-for-text-classification-a01f89b179fc?sk=1fdd9847fcfa70c772f317d3eeeaec07 π₯ Fine-tuning LLMs: https://youtu.be/eC6Hd1hFvos π₯ Compressing LLMs: https://youtu.be/FLkUOkeMd5M π» GitHub Repo: https://github.com/ShawhinT/YouTube-Blog/tree/main/LLMs/model-compression π€ Model: https://huggingface.co/shawhin/bert-phishing-classifier_teacher πΏ Dataset: https://huggingface.co/datasets/shawhin/phishing-site-classification References: [1] https://arxiv.org/abs/1810.04805 [2] https://arxiv.org/abs/1511.01432 [3] https://arxiv.org/abs/1801.06146 Intro - 0:00 Fine-tuning - 0:55 BERT - 5:09 Text Classification - 8:39 Example (Motivation) - 9:41 Example Code: Fine-tuning BERT on Phishing URLs - 10:55