Tag: Open Source
-
Go Big or Go Home, Part 3: Testing A LOT of models on the New GPU Cluster
Two RTX 3090s, 128 GB of ECC memory, and four open-weight models: testing hybrid inference, long context, MTP, agents, and real applications.
-
Go Big or Go Home, Part 2: Commissioning the new GPU cluster
Before We Try to Break It Part 1 covered why I rebuilt my local AI system around WRX90, a Threadripper PRO 9955WX, 128 GB of eight-channel ECC RDIMM, two RTX 3090 Founders Edition cards, Ubuntu, air cooling, and hardware-level remote management. When almost $11,000 in tracked hardware acquisition value sits inside one case, “it boots”…
-
Go Big or Go Home, Part 1: My New AI Cluster
Before We Start I built a new local AI server. It is fully operational, and I have the benchmark data—and the results from running some seriously large open-source models—to prove it. Local AI rigs exploded in popularity in 2026 alongside the growing demand for models that people can run on their own hardware. Unfortunately, the…
-
Owning Your Agent part 1: Local Agentic Work with Hermes on Dual RTX 3090s
“Never send a human to do a machine’s job.” – Agent Smith, The Matrix (1999) You fire up your machine and stare aimlessly into the terminal — “or whatever ‘insert AI company name’ app you opened today” — and your reflection stares back at you from the screen. You’re waiting on Claude Code. Again. The…
-
48 GB of VRAM and a Dream – Part 1: The Build
A quick note before you read: In light of the ongoing AI bubble, I have provided a full cost breakdown of all parts of when I bought them. I am currently in the process of building a new AI cluster — a big upgrade . When it’s done, I will post about it. I hope…