The One-Line Slowdown: Why AI Models Get Slower
Learn more about model collapse here → https://ibm.biz/~bs0HZQOH7 Your AI model runs, but the output is wrong. Antoni Viros i Martin explains how hidden synchronization and graph breaks can quietly slow AI training and reduce compiler optimizations. Learn a practical debugging mindset for improving AI model performance in PyTorch and compiled workloads. 00:00 - The Hidden Cost of Reading a Single Tensor Value 00:13 - How Torch.compile Optimizes Your Model 00:35 - Why Accelerators Work Ahead of Python 00:48 - The .item() Problem: Python Scalar Reads 01:12 - How Graph Breaks Fragment Optimized Regions 01:56 - Synchronization: When Python Forces the Chip to Wait 02:55 - The Real Performance Penalty: Empty Accelerator Queues 03:03 - How to Avoid These Slowdowns in Compiled Models Continue your education in the course Compilation for Dataflow on Coursera here → https://ibm.biz/~yeC2veTHU AI news moves fast. Sign up for a monthly newsletter for AI updates from IBM → https://ibm.biz/~6cdGktmYf AI was used in the creation of the transcript and metadata for this video. #aimodels #aitraining #pytorch #ai --------------------------------------------------------------------------------------------------------- Find us on YouTube: 🔵 IBM Technology: https://www.youtube.com/@IBMTechnology 🔵 IBM: https://www.youtube.com/@IBM 🔵 IBM Developer: https://youtube.com/@IBMDeveloperAdvocates
