3,000 Tokens/Sec Locally: Testing the ZGX Fury
In this video, I look at the ZGX Fury which is the big brother of the ZGX Nano (DGX Spark). While many people know the GB10s, most people haven't seen the power of what a machine like HP's ZGX Fury can do. With 748 GB of memory and NVIDIA's GB300 chipset, this is a mini data center your whole team can use HP ZGX Fury : https://www.hp.com/us-en/workstations/ai-stations/zgx-fury-ai-station.html HP Z LinkedIn Page: https://www.linkedin.com/showcase/zbyhp/home/ QuickSpecs: https://h20195.www2.hp.com/v2/GetPDF.aspx/c09307810?jumpid=va_ctk9ni875y Datasheet: https://h20195.www2.hp.com/v2/GetPDF.aspx/c09307810?jumpid=va_ctk9ni875y HP ZGX Fury Sizzle Video: https://www.youtube.com/watch?v=9hwxLrkR1p0 Sam's 2nd Channel: https://www.youtube.com/channel/UCUF7WtR4JpVbQqcQGrLeADw Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes ⏱️Time Stamps: 00:00 Intro: HP ZGX Fury 01:05 What is the HP ZGX Fury? 01:17 GB300, 20 petaflops and 748GB of memory 02:09 How the Fury's memory works 03:16 What makes HP's DGX Station different 03:38 HP ZGX Runtime (ZRT) 05:24 HP Z Toolkit 05:35 Red Hat Enterprise Certified 06:57 Benchmarks 08:25 Who is this for? 09:11 Running agentic systems locally 10:29 On-prem AI 11:26 Data-center hardware next to your desk 12:39 Final thoughts
