Analyzing a handful of local models that fit within a specific GPU memory ceiling, looking to learn how much compression impacts performance, how differently compressed models @ similar size compare, and how kv cache impacts attention in some cases.
Benchmarks writeup: https://hkinsley.com/reflections/in-search-of-the-frontier-at-home
DeepSeek V4 Flash: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash
RTX Pro 6K discord: https://discord.gg/gzpPGAAwDj
Neural Networks from Scratch book: https://nnfs.io
Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join
Discord: https://discord.gg/sentdex
Reddit: https://www.reddit.com/r/sentdex/
Support the content: https://pythonprogramming.net/support-donate/
Twitter: https://twitter.com/sentdex
Instagram: https://instagram.com/sentdex
Facebook: https://www.facebook.com/pythonprogramming.net/
Twitch: https://www.twitch.tv/sentdex
Choose to Build with AI
Matched to Python
AI Maker Residence 3
The third AI workshop taught by our legendary teacher, Nick Sarafa. This is a full-day hands-on training workshop for purposeful co-creation with AI using Claude Code.
Imagine having access to hundreds of billions of dollars of computing power and knowing exactly how to make it work for you through the power of super intelligence.
◆ Fri 09 Oct 2026◆ KOKO Cafe, London◆ With Nick Sarafa
