Local LLM Challenge | Speed vs Efficiency

I put three systems to the local LLM test.

🛒 Gear Links 🛒
💻🔄 K9 Mini with 32GB RAM: amzn.to/3ZiKjcp
🛠️🚀 96GB RAM kit: amzn.to/3ZhQ4qR
🍏💥 Mac Mini M2 Pro: amzn.to/4fbgmzY
🎧⚡ RTX 4090: amzn.to/3YvvHpg
🛠️🚀 Mini PC with Oculink: amzn.to/3UgLNAK
📦🎮 My gear: www.amazon.com/shop/alexziskind

🎥 Related Videos 🎥
🤯 Cheap mini runs a 70B LLM -    • Cheap mini runs a 70B LLM 🤯  
🤖 It’s over…my new LLM Rig -    • It’s over…my new LLM Rig  
🌗 RAM torture test on Mac -    • TRUTH about RAM vs SSD UPGRADES for MacBook  
🛠️ FREE Local LLMs on Apple Silicon | FAST! -    • FREE Local LLMs on Apple Silicon | FAST!  
🛠️ Set up Conda -    • python environment setup on Apple Silicon ...  
🤖 INSANE Machine Learning on Neural Engine -    • INSANE Machine Learning on Neural Engine |...  

🛠️ Developer productivity Playlist -    • Developer Productivity  
🔗 AI for Coding Playlist: 📚 -    • AI  

— — — — — — — — —

❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺
Click here to subscribe:    / @azisk  

— — — — — — — — —

Join this channel to get access to perks:
youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join

— — — — — — — — —

📱 ALEX ON X: twitter.com/digitalix

#machinelearning #llm #softwaredevelopment