Using NEW MPT-7B in Hugging Face and LangChain

From the creator

Let's take a look at Mosaic ML's new MPT-7B LLM. We'll see how to use any MPT-7B model (instruct, chat, and storywriter-65k) in both Hugging Face transformers and LangChain. By using MPT-7B in LangChain we give it access to all of the tooling available via the library, like AI agents, chatbot functionality, and more. 🔗 Notebook link: https://github.com/pinecone-io/examples/blob/master/learn/generation/llm-field-guide/mpt/mpt-7b-huggingface-langchain.ipynb 🌲 Subscribe for Latest Articles and Videos: https://www.pinecone.io/newsletter-signup/ 👋🏼 AI Consulting: https://aurelio.ai 👾 Discord: https://discord.gg/c5QtDB9RAP Twitter: https://twitter.com/jamescalam LinkedIn: https://www.linkedin.com/in/jamescalam/ 00:00 Open Source LLMs like MPT-7B 00:50 MPT-7B Models in Hugging Face 02:29 Python setup 04:16 Initializing MPT-7B-Instruct 06:28 Initializing the MPT-7B tokenizer 07:10 Stopping Criteria and HF Pipeline 09:52 Hugging Face Pipeline 14:18 Generating Text with Hugging Face 16:01 Implementing MPT-7B in LangChain 17:08 Final Thoughts on Open Source LLMs #artificialintelligence #nlp #langchain #deeplearning #huggingface

Choose to Build with AI
Matched to ChatGPT

AI Maker Residence 3

The third AI workshop taught by our legendary teacher, Nick Sarafa. This is a full-day hands-on training workshop for purposeful co-creation with AI using Claude Code. Imagine having access to hundreds of billions of dollars of computing power and knowing exactly how to make it work for you through the power of super intelligence.

◆ Fri 09 Oct 2026 ◆ KOKO Cafe, London ◆ With Nick Sarafa
AI Maker Residence 3
Live event
AI Maker Residence 3
Fri 09 Oct 2026

More like this

Running one yourself?

List your AI event,
wherever it is.

A meetup, a workshop, a hackathon, a conference. Any city, or online. Tell us about it and it lands in front of people already learning this stuff.