190 tokens per second: a 35-billion-parameter model on a laptop A 35-billion-parameter language model shouldn’t fit in 16 gigabytes of video memory, let alone generate at nearly two hundred tokens per second. And yet it happens, provided you accept two architectural constraints and treat the key-value cache as a design variable. Here is what we measured, with the complete numbers and the parameters that mattered. ...
I told you the architecture of the Telegram gateway that mirrors VS Code conversations onto my GX10. This morning was the first shift where the setup did real work — and it produced exactly the kind of morning a blog post never plans for: a .NET solution that wouldn’t build, a private npm feed answering 401, and a personal access token pasted into the chat. Full story, minus the token. ...
Until recently I could talk to my agent from exactly two places: the GX10’s terminal, or VS Code sitting in front of one of the two machines. An agent that only answers when you’re at your desk is an agent with office hours. ...
My GX10 has been working hard: it runs models locally around the clock, and neither of the previous posts ever said how much. It was time to stop answering “I guess it’s fine” and open a dashboard. Here’s how I built it — and the numbers from its first proper week of work. ...
Until today, every article on this blog had an aesthetic problem: no cover image. PaperMod shows covers on the home page, in lists, and at the top of each post — without an image, the layout loses half of its impact. Drawing them by hand every time, though, was the quickest way to stop publishing anything. ...
Over the past few days I have spent my time optimizing the communication between the two main machines of my setup: my gaming laptop, the Strix Scar 16, and the home server GX10. The goal was clear: create a smooth workflow that lets me leverage the server’s compute power to run heavy local models while using the laptop’s interface for everyday interaction. ...
On the ASUS Ascent GX10 I finally have the setup I wanted: Qwen3.8 Flash Next running locally, with a systemd service that starts at boot and a script to switch models on the fly. This post documents the current installation and closes the Qwen3.6 chapter. ...