Open Source LLMs on GOD mode. Local LLMs MAXXED OUT on the RTX 5090!
In this video, we'll explore the power of running large language models (LLMs) entirely locally on an RTX 5090 GPU. I'll demonstrate how easily you can use open-source LLMs locally using LM Studio, showcasing models like DeepSeek R1 and GEMMA 3 27B. We'll dive into various LLM capabilities including text generation, multimodal AI, and even touch on future possibilities of video and image generation. This is Part 2 of a three-part series on the RTX 5090, with today’s focus on LLMs and their local performance on this powerful GPU. ▼ Link(s) From Today’s Video: Run LLMs Locally for yourself!: https://lmstudio.ai/ Learn More about RTX 5090: https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5090/ Check out Part One: https://www.youtube.com/watch?v=eBaEhpImpDI&t=1431s&ab_channel=MattVidProAI ► MattVidPro Discord: https://discord.gg/mattvidpro ► Follow Me on Twitter: https://twitter.com/MattVidPro ► Buy me a Coffee! https://buymeacoffee.com/mattvidpro ------------------------------------------------- ▼ Extra Links of Interest: General AI Playlist: https://www.youtube.com/playlist?list=PLrfI66qWYbW3acrBQ4qltDBsjxaoGSl3I AI I use to edit videos: https://www.descript.com/?lmref=nA4fDg Instagram: instagram.com/mattvidpro Tiktok: tiktok.com/@mattvidpro Gaming & Extras Channel: https://www.youtube.com/@MattVidProGaming Let's work together! - For brand & sponsorship inquiries: https://tally.so/r/3xdz4E - For all other business inquiries: mattvidpro@smoothmedia.co Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe! All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them. 00:00 Introduction to Running LLMs Locally 01:27 Setting Up LM Studio 01:58 Testing DeepSeek R1 on RTX 5090 02:42 Exploring Model Settings and Performance 03:48 Generating Content with DeepSeek R1 06:19 Loading Larger Models 09:44 Pushing the Limits with 32B Models 12:47 Reflections on Local AI Performance 16:55 Introduction to GEMMA 327B 17:15 Setting Up the Model 18:00 First Impressions and Performance 18:47 Roasting with GEMMA 22:48 Analyzing Memes and Humor 27:53 Exploring Smaller LLMs 30:49 Conclusion and Future Plans
