In this video, I’ll show you how to install LLaMA 2 locally. We will install LLaMA 2 chat 13b fp16, but you can install ANY LLaMA 2 model after watching this video. I also put LLaMA 2 chat 13b fp16 through an extensive test. Does it do better than LLaMA 2 70b? Let’s find out!
Enjoy 🙂
See NordPass Business in action now with a 3-month free trial here: nordpass.com/matthewberman code:matthewberman
Become a Patron ? – https://patreon.com/MatthewBerman
Join the Discord ? – https://discord.gg/xxysSXBxFW
Follow me on Twitter ? – https://twitter.com/matthewberman
Subscribe to my Substack ?? – https://matthewberman.substack.com
Chapters:
0:00 – Intro
0:23 – Install Guide
3:40 – Testing LLaMA 2 13b fp16
Links:
Install Commands – https://gist.github.com/mberman84/45545e48040ef6aafb6a1cb3442edb83
Runpod – bit.ly/3OtbnQx
LLM Leaderboard – https://tide-freckle-52b.notion.site/1e0168e3481747ebaa365f77a3af3cc1?v=83e3d58d1c3c45ad879834981b8c2530&pvs=4
In-Depth Local Install Tutorial – https://www.youtube.com/watch?v=VPW6mVTTtTc
LLaMA 2 Announcement – https://www.youtube.com/watch?v=E-WOR6jfBLo
LLaMA 2 70b Testing – https://www.youtube.com/watch?v=Xjy-CDRJa54
TextGen WebUI – https://github.com/oobabooga/text-generation-webui
Torch Download URL – https://download.pytorch.org/whl/cu117
LLaMA 2 13b chat fp16 – https://huggingface.co/TheBloke/Llama-2-13B-Chat-fp16
