“Running Local Models Is Good Now” Was Written on a 64GB Mac. Half of You Have 16GB or Less

"52% of PCs have 16GB RAM or less. Here’s what local LLMs actually fit, what the KV cache costs you, and why Mac and PC 16GB are not equal. Continue reading on Towards AI »"