A month ago I published a post on this site about the same card. An image generation app was doing nothing at all and holding 2.65GB of VRAM, and my local coding model generated at 28.2 tok/s instead of 41.0. Not one error was thrown. That post had two points on it. So I never…
A title went up on r/LocalLLaMA: “Qwen3.8 27B at 50 tok/s with 100k Context on a 16GB GPU!” 100k of context on 16GB, with a 27B model, at 47–50 tokens a second. Those three figures are the OP’s report, not my measurement. The method is KVarN, a feature of the llama.cpp fork beellama.cpp that tiers…
Same machine, same Python, same one-line command. The result depended on who launched that Python. When I opened an SSH session by hand and typed python -c “import torch”, it passed. When my daemon brought the GPU image server up on that machine automatically, the same import torch died like this: OSError: [WinError 4551] ……
My GPU worked for 28 minutes and 37 seconds without a single complaint. Every step ran, and sampling finished. Then the last node in the graph printed this. RuntimeError: expected input to have 48 channels, but got 16 Decoding never started. Everything those 28 minutes and 37 seconds produced went straight in the bin. The…
My development rules contain one line: Code generation goes to the local model. The cloud model plans and reviews. On 26 June 2026 I added two words to it: no exceptions. That phrase survived five days. On 1 July I conceded the first exception and rewrote the line myself. The rule itself came out of…
My coding sessions run on a machine at home, and I’m away from that machine far more than I’m sitting in front of it. So I built a way to keep typing into those same sessions from my phone. Moonlight does this for game screens. I did it for text. The most expensive thing that…
Two local embedding models ranked the same 24 bookmarks identically — 8 of 8 correct each. Their similarity scores sat in almost non-overlapping ranges, and one hardcoded 0.75 cutoff silently erased every result from one of them.
A cloud model wrote 1,900 lines in one session and burned my five-hour limit — then the next session remembered none of it. Three layers of context files plus hooks, and what each one is actually for.