Most local-LLM benchmarks come off machines almost nobody owns. I measure on a single GPU bought for gaming, publish the raw figures — deviation, settings, commands — and include the results that don't flatter the parts I picked.
Latest 6 min read
My home server ran out of disk. I fixed it, rebooted, and rebooted, and rebooted, and three hours later I realized my remote-access bridge was dead. That’s the thing that lets me…
Read more →The requirement was one sentence. I wanted to handle a verification prompt landing on a phone that isn’t in my hand, from the screen I’m already looking at. Reading that sentence, I pictured one automation. Something that catches a notification and forwards it somewhere, and I’m done. What came out was three builds that share…
Every morning at 08:00 a message arrives in my Discord. Today’s weather, today’s calendar, and what moved in my Obsidian vault yesterday. I didn’t open a single app to get it. I’m not a developer, and I built the thing that sends it. It has run every day for more than three months. Today I’m…
I was in the middle of a measurement when two remote servers went unreachable at the same time. The coding llama-server on port 8080, and the occupier server I’d started on port 8081 for that measurement. 8080 was the same server that had been answering normally a few minutes earlier. curl waited more than eight…
A month ago I published a post on this site about the same card. An image generation app was doing nothing at all and holding 2.65GB of VRAM, and my local coding model generated at 28.2 tok/s instead of 41.0. Not one error was thrown. That post had two points on it. So I never…
A title went up on r/LocalLLaMA: “Qwen3.8 27B at 50 tok/s with 100k Context on a 16GB GPU!” 100k of context on 16GB, with a 27B model, at 47–50 tokens a second. Those three figures are the OP’s report, not my measurement. The method is KVarN, a feature of the llama.cpp fork beellama.cpp that tiers…
I shipped a browser extension and used it every day for a month. Then I asked one person to try it. They hit three problems in about an hour. I’d hit none of them in thirty days. What got me wasn’t the count. It was that all three were the same problem wearing different clothes….
I read the same value five times in a row and wrote down that it was verified. It was backwards. And the tool I read it with doesn’t support reading that value at all. Here’s the part that stayed with me. The command didn’t fail. It returned a plausible number, exited 0, and did it…
I started writing this blog in English, which meant showing up on Reddit and Hacker News. Reading was fine. Writing was the bottleneck. Every comment went through the same loop. Think it in Korean, convert it to English I’d be willing to post, check it again. For a two-paragraph reply that loop cost me minutes,…
I run a local coding model and an image generation app on the same card. The image app was doing nothing at the time. Its queue was empty and nothing was being drawn. It was holding 2,651MB of VRAM anyway. I stopped it and sent the same prompt again. Generation went from 28.2 t/s to…
Same machine, same Python, same one-line command. The result depended on who launched that Python. When I opened an SSH session by hand and typed python -c “import torch”, it passed. When my daemon brought the GPU image server up on that machine automatically, the same import torch died like this: OSError: [WinError 4551] ……