SSH 119: Why So Many Llamas?¶
- Air Date: 2024-03-20
- Duration: 47 mins 30 secs
About this episode¶
Alex rolls back a major server upgrade, and we have fun playing with local large language models.
Your hosts¶
Sponsored by¶
- Tailscale: Tailscale is a Zero config VPN. It installs on any device in minutes, manages firewall rules for you, and works from anywhere. Get 3 users and 100 devices for free.
- This Week in Bitcoin: A high-signal Bitcoin news podcast focused on analysis you'll find valuable.
Episode links¶
- ⚡ Grab Sats with Strike Around the World — Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries.
- 🎉 Boost with Fountain FM — Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.
- Training AI to Play Pokemon with Reinforcement Learning
- Open WebUI — Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI for various LLM runners, supported LLM runners include Ollama and OpenAI-compatible APIs.
- Ollama — Get up and running with large language models, locally.
- Alex's Nix Nvidia Config
- tlm — Local CLI Copilot, powered by CodeLLaMa.
- LM Studio - Discover, download, and run local LLMs — 🤖 - Run LLMs on your laptop, entirely offline 👾 - Use models through the in-app Chat UI or an OpenAI compatible local server 📂 - Download any compatible model files from HuggingFace 🤗 repositories 🔭 - Discover new & noteworthy LLMs in the app's home page
- Hugging Face — The Home of Machine Learning
- 🍔 Lunch at SCaLE 🍇 — Let's put an official time down on the calendar to get together. The Yardhouse has always been a solid go-to, so sit down and break bread with the Unplugged crew during the lunch break on Saturday!
Tags¶
boosts, home assistant, jupiter broadcasting, llm runners, ollama, open webui, reinforcement learning, self-hosting podcast, training ai