How To Install LLaMA 2 Locally + Full Test (13b Better Than 70b??)

ByEditor

In this video, I’ll show you how to install LLaMA 2 locally. We will install LLaMA 2 chat 13b fp16, but you can install ANY LLaMA 2 model after watching this video. I also put LLaMA 2 chat 13b fp16 through an extensive test. Does it do better than LLaMA 2 70b? Let’s find out!

Enjoy 🙂

See NordPass Business in action now with a 3-month free trial here: nordpass.com/matthewberman code:matthewberman

Become a Patron ? – https://patreon.com/MatthewBerman
Join the Discord ? – https://discord.gg/xxysSXBxFW
Follow me on Twitter ? – https://twitter.com/matthewberman
Subscribe to my Substack ?? – https://matthewberman.substack.com

Chapters:
0:00 – Intro
0:23 – Install Guide
3:40 – Testing LLaMA 2 13b fp16

Links:
Install Commands – https://gist.github.com/mberman84/45545e48040ef6aafb6a1cb3442edb83
Runpod – bit.ly/3OtbnQx
LLM Leaderboard – https://tide-freckle-52b.notion.site/1e0168e3481747ebaa365f77a3af3cc1?v=83e3d58d1c3c45ad879834981b8c2530&pvs=4
In-Depth Local Install Tutorial – https://www.youtube.com/watch?v=VPW6mVTTtTc
LLaMA 2 Announcement – https://www.youtube.com/watch?v=E-WOR6jfBLo
LLaMA 2 70b Testing – https://www.youtube.com/watch?v=Xjy-CDRJa54
TextGen WebUI – https://github.com/oobabooga/text-generation-webui
Torch Download URL – https://download.pytorch.org/whl/cu117
LLaMA 2 13b chat fp16 – https://huggingface.co/TheBloke/Llama-2-13B-Chat-fp16

Similar Posts

  • I Used AI Text to Video to Create a Faceless YouTube Channel

    A full tutorial on how to create no-face (faceless) YouTube videos using the ai tools ChatGPT and InVideo as a beginner with no experience. Perfect as a side hustle, or full time YouTube career.

    ? To sign-up use this link https://invideo.io/?ref=obscuriousmind along with code OM25 for a 25% discount
    ? Follow InVideo’s official YT channel for more hacks on creating videos with ease – https://bit.ly/3scIvQi
    ? InVideo is launching InVideo AI soon which will redefine video creation and will enable people to create videos out of simple text prompts: https://invideo.io/ai

    —————————————————————

    ChatGPT Prompts

    Generating Ideas
    – What are the 10 craziest, yet widely unknown facts about [topic]
    – Provide 10 out of the box ideas for YouTube Shorts about [topic]. Focus on ideas that are unique and unconventional.
    – What are 10 controversial topics related to [topic]
    – I need 10 YouTube shorts ideas that will engage my audience with a unique and compelling perspective on [topic]

    Scripting
    – Paraphrase this text into a compelling YouTube shorts script. Make sure to keep the most important points intact, but make it as concise as possible due to the time constraints:
    – Reformat and paraphrase this into a YouTube Shorts script, but make it as concise as possible due to the time constraints:
    – Create an engaging YouTube shorts script for [topic]. The first sentence needs to instantly capture attention and curiosity. Be as concise in your language as possible due to the time constraints. Make every sentence compelling or witty.
    – Generate 3 alternatives that are [more witty, compelling, shorter, etc.]

    Titles
    – Create 10 creative and catchy title options. They should be short and attention grabbing. Avoid using cliches or generic titles.
    – Create 10 creative and catchy title options. They should be short and attention grabbing. Avoid using cliches or generic titles. Make them alluring and clickable without giving away the content.

    ——————————————————————-

    Step by step how to create faceless YouTube automation channels using ai tools. ChatGPT and InVideo automate much of the process for creating YouTube shorts as well as long form videos. Faceless YouTube automation with ai is a great way to make money online. Using ChatGPT, and ai video editor, and ai video generator is the best way to automate your faceless YouTube channel to start making money online.

    Chapters
    0:00 Intro
    0:47 Demo
    1:08 ChatGPT Roadblocks
    1:35 Profitable Niches
    2:18 Getting Ideas
    7:50 Writing the Script
    9:22 InVideo Intro
    10:10 Editing Your Video
    14:47 Video Playthrough
    15:42 New AI Features