Mixtral 8X7B — Deploying an *Open* AI Agent
Mistral AI's new model — Mixtral 8x7B — is pretty impressive. We'll see how to get set up and deploy Mixtral 8X7B, the prompt format it requires, and how it performs when being used as an Agent — we even add in some Mixtral RAG at the end. As a bit of a spoiler, Mixtral is probably the first open-source LLM that is truly very very good — I say this considering the following key points: - Benchmarks show it to perform better than GPT-3.5. - My own testing shows Mixtral to be the first open weights model we can reliably use as an agent. - Due to MoE architecture it is very fast given its size. If you can afford to run on 2x A100s and latency is good enough to be used in chatbot use cases. 📕 Mixtral 8X7B Page: https://www.pinecone.io/learn/mixtral-8x7b 📌 Code Notebook: https://github.com/pinecone-io/examples/blob/master/learn/generation/llm-field-guide/mistral-ai/mixtral-8x7b/00-mixtral-8x7b-agent.ipynb 🌲 Subscribe for Latest Articles and Videos: https://www.pinecone.io/newsletter-signup/ 👋🏼 AI Dev: https://aurelio.ai 👾 Discord: https://discord.gg/c5QtDB9RAP Twitter: https://twitter.com/jamescalam LinkedIn: https://www.linkedin.com/in/jamescalam/ 00:00 Mixtral 8X7B is better than GPT 3.5 00:50 Deploying Mixtral 8x7B 03:21 Mixtral Code Setup 08:17 Using Mixtral Instructions 10:04 Mixtral Special Tokens 13:29 Parsing Multiple Agent Tools 14:28 RAG with Mixtral 17:01 Final Thoughts on Mixtral #artificialintelligence #nlp #ai #chatbot #opensource
