In this video, we review two implementations of Microsoft’s Orca paper, Orca Mini V2 and OpenChat Open Orca Preview. Both are highly capable and smaller models that are put to the test. Which one will win?
Enjoy 🙂
Become a Patron ? – https://patreon.com/MatthewBerman
Join the Discord ? – https://discord.gg/xxysSXBxFW
Follow me on Twitter ? – https://twitter.com/matthewberman
Subscribe to my Substack ?? – https://matthewberman.substack.com
Links:
Runpod – bit.ly/3OtbnQx
Quant Orca Mini V2 – https://huggingface.co/TheBloke/orca_mini_v2_13b-GPTQ
Unquant Orca Mini V2 – https://huggingface.co/psmathur/orca_mini_v2_13b
Unquant Open Orca – https://huggingface.co/Open-Orca/OpenOrca-Preview1-13B
Quant Open Orca – https://huggingface.co/TheBloke/openchat_v2_openorca_preview-GPTQ
Orca Research Paper – https://arxiv.org/abs/2306.02707
LLM Leaderboard – https://tide-freckle-52b.notion.site/1e0168e3481747ebaa365f77a3af3cc1?v=83e3d58d1c3c45ad879834981b8c2530&pvs=4