Hardware

190 tokens per second: a 35-billion-parameter model on a laptop A 35-billion-parameter language model shouldn’t fit in 16 gigabytes of video memory, let alone generate at nearly two hundred tokens per second. And yet it happens, provided you accept two architectural constraints and treat the key-value cache as a design variable. Here is what we measured, with the complete numbers and the parameters that mattered. ...

Qwen3.8 Flash Next on my GX10: install, systemd and goodbye Qwen3.6

On the ASUS Ascent GX10 I finally have the setup I wanted: Qwen3.8 Flash Next running locally, with a systemd service that starts at boot and a script to switch models on the fly. This post documents the current installation and closes the Qwen3.6 chapter. ...