In this video, we thoroughly test Mistral 7b Open Orca GPTQ. Itā€™s an incredibly performant small model that illustrates the future of locally hosted edge models. How good is it? Does it beat LLaMA 13b? Letā€™s find out!

Enjoy šŸ™‚

Become a Patron ? ā€“ https://patreon.com/MatthewBerman
Join the Discord ? ā€“ https://discord.gg/xxysSXBxFW
Follow me on Twitter ? ā€“ https://twitter.com/matthewberman
Follow me on TikTok ? ā€“ https://www.tiktok.com/@matthewberman60
Subscribe to my Substack ?? ā€“ https://matthewberman.substack.com
Media/Sponsorship Inquiries ? ā€“ https://bit.ly/44TC45V

Links:
LLM Leaderboard ā€“ https://bit.ly/3qHV0X7
Runpod (Affiliate)- https://bit.ly/3OtbnQx
Runpod Tutorial ā€“ https://www.youtube.com/watch?v=_59AsSyMERQ
Runpod Textgen Template ā€“ https://bit.ly/3EqiQdl

Similar Posts