Neutrino-8B Locally: Extreme Quantization Done Right
This video installs and tests Neutrino-8B, whose every transformer linear is stored five-valued (sub-2 bits per weight) in a single 2.56 GB container. 🔥 Get 50% Discount on any A6000 or A5000 GPU rental, use following link and coupon: https://bit.ly/fahd-mirza Coupon code: FahdMirza 🔥 Buy Me a Coffee to support the channel: https://ko-fi.com/fahdmirza #neutrino8b PLEASE FOLLOW ME: ▶ LinkedIn: / fahdmirza ▶ YouTube: / @fahdmirza ▶ Blog: https://www.fahdmirza.com RESOURCES: ▶ https://huggingface.co/FermionResearch/Neutrino-8B All rights reserved © Fahd Mirza