Can an AI agent act as a machine learning researcher? In this tutorial, I'll show you how to automate the training of AI models from scratch using AI agents, saving you time and computational costs.
We'll be using a modified version of Andrej Karpathy's NanoGPT repository to train a GPT-2 level model on FineWeb with a single GPU. I'll walk you through how to use Claude Code, Hugging Face Jobs, and Trackio to build a self-optimizing AI pipeline that finds the best learning rates and hyper-parameters while you sleep!
Hugging Face Jobs: https://huggingface.co/docs/hub/jobs
Trackio: https://github.com/gradio-app/trackio
Here's the modified NanoGPT training script: https://github.com/gradio-app/trackio/blob/main/autonomous-experiments/01_finding_the_best_learning_rate/train_nanogpt.py
Don't forget to like, subscribe, and hit the notification bell to stay up-to-date with our latest AI tutorials and open-source projects like Trackio and Daggr!
Choose to Build with AI
Matched to Claude Code
AI Maker Residence 3
The third AI workshop taught by our legendary teacher, Nick Sarafa. This is a full-day hands-on training workshop for purposeful co-creation with AI using Claude Code.
Imagine having access to hundreds of billions of dollars of computing power and knowing exactly how to make it work for you through the power of super intelligence.
◆ Fri 09 Oct 2026◆ KOKO Cafe, London◆ With Nick Sarafa