e_ engreads

Latest  /  May 25, 2026

Posts from May 25, 2026

2 posts from engineering leaders published May 25, 2026, by Salvatore Sanfilippo and Michael Lopp (Rands).

May 25, 2026 2 POSTS

Distributing LLM inference in DwarfStar

High end NVIDIA cards, and the server and power needed to run them, cost a lot of money, especially if you plan to reach enough VRAM to run massive models. The alternative, so far, has been Apple hardware, or the DGX Spark that, even if severely limited because of memory…

Systems & Infra

The Ask

Coffee in hand, I sit down in the Cave. Any Tuesday during the work week, a sip, and I parse the calendar. 1:1 — he’s fine. Status meeting — listen. Staff meeting — read the notes from last week. Exec review — figure out the biggest fire, have a defensible opinion. Wait — Mark…

Leadership & Management