Tag: llama.cpp
-
Go Big or Go Home, Part 3: Testing A LOT of models on the New GPU Cluster
Two RTX 3090s, 128 GB of ECC memory, and four open-weight models: testing hybrid inference, long context, MTP, agents, and real applications.
-
Owning Your Agent part 1: Local Agentic Work with Hermes on Dual RTX 3090s
“Never send a human to do a machine’s job.” – Agent Smith, The Matrix (1999) You fire up your machine and stare aimlessly into the terminal — “or whatever ‘insert AI company name’ app you opened today” — and your reflection stares back at you from the screen. You’re waiting on Claude Code. Again. The…
-
The Memory Must Flow: Why I Built a Dune-Themed CLI to Analyze Local AI Memory on Apple Silicon
“Thou shalt not make a machine in the likeness of a human mind.” — Orange Catholic Bible, Dune THE DUNE CONNECTION – INSPIRATION FOR MELANGE I was gifted all six Dune books years ago as a Christmas gift. They traveled with me unread through three apartments, collecting dust. At the start of 2026, I finally…