In this video I explain how to process data for question and answering systems.
I start with BERT and show how one can easily transfer it to other transformer based models such as RoBERTa.
Please note that I am only talking about building and difference in data processing and not about the difference in these two models.
I have also made the data-processing code for both available to everyone.
The BERT code can be found here: https://www.kaggle.com/abhishek/roberta-inference-5-folds
The RoBERTa code can be found here: https://www.kaggle.com/abhishek/roberta-inference-5-folds
Please dont forget to click on the like button and subscribe my channel :)
#DeepLearning #BERT #QuestionAnswering
Follow me on:
Twitter: https://twitter.com/abhi1thakur
LinkedIn: https://www.linkedin.com/in/abhi1thakur/
Kaggle: https://kaggle.com/abhishek
Choose to Build with AI
Matched to AI Coding
AI Maker Residence 3
The third AI workshop taught by our legendary teacher, Nick Sarafa. This is a full-day hands-on training workshop for purposeful co-creation with AI using Claude Code.
Imagine having access to hundreds of billions of dollars of computing power and knowing exactly how to make it work for you through the power of super intelligence.
◆ Fri 09 Oct 2026◆ KOKO Cafe, London◆ With Nick Sarafa