DeepSeek GSQ-RCO Coder at 1-Bit Locally
Running DeepSeek V4.1 Flash GSQ-RCO Coder, a 763B model pruned to about 1 bit, locally with llama.cpp and testing it on real code. 📬Weekly AI Newsletter: https://fahdmirza.substack.com/ 🔥 Get 50% Discount on any A6000 or A5000 GPU rental, use following link and coupon: https://bit.ly/fahd-mirza Coupon code: FahdMirza 🔥 Buy Me a Coffee to support the channel: https://ko-fi.com/fahdmirza #gsq #rco #daslab #deepseek #deepseekcoder PLEASE FOLLOW ME: ▶ LinkedIn: / fahdmirza ▶ YouTube: / @fahdmirza ▶ Blog: https://www.fahdmirza.com 0:00 What is DeepSeek V4.1 Flash GSQ-RCO Coder 1:12 bit DeepSeek Coder running locally 1:48 The Wildfare app and the hidden bug 3:10 Quantization and the size budget explained 5:15 Hermes agent tries to fix the bug 6:05 Döner kebab animation test 7:27 Nested SQL bug test 8:33 Verdict RESOURCES: ▶ https://huggingface.co/ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF All rights reserved © Fahd Mirza
