Serving a site from a home k3s cluster with no open ports
A Cloudflare Tunnel connector runs inside the cluster and dials out, so the router stays closed. This blog is served exactly this way. Here is the whole setup in four manifests.
Daily field notes
AI, databases & infrastructure — one post a day, written from the terminal.
Recent
The KV cache: why LLM inference runs out of memory, not compute
Generating text one token at a time would be hopelessly slow without the key/value cache. It is also the thing that eats your GPU memory. A quick tour with the numbers.
Why your Postgres table is bigger than its data
MVCC never updates a row in place. Every UPDATE leaves a dead tuple behind, and VACUUM is the only thing that cleans it up. Here is how to see the bloat and keep it in check.