Given how quickly things evolve, it’s easy to get lost in the numerous offerings and hard to get the best deal. So, what do you use? Both clients/harnesses and LLM providers or local setups would be interesting.
Personally, I’ve been using opencode with Github copilot for work. I’m currently looking for cost-effective provider for personal work. Maybe openrouter with one of the cheap models?
I use opencode with locally-hosted llama.cpp - usually with qwen3.6-35b-a3b.
I tried opencode go for a couple month, and its definitely nice to have an lln runner with more gram and more GPUs, but I prefer to have all my stuff local whenever it’s possible. Also, I’d use up my token allotments fairly quickly on opencode go.
I also tried opentouter and it, too, was great - many more models. But I exhausted by credits even quicker than opencode go, and its also not local.
What hardware do you use? How fast is it?
AMD Ryzen 9 9950X CPU and AMD radeon pro w7900 (48GB vram). I get 55tps output pretty consistently, but ingesting context starts around 1500tps and if context size reaches, say, 50K, tps drops to around 200tps. I often have to wait a bit, but it’s a price I’m happy to pay for local-only AI
Nothing. I threw them all out. After is forgot how to write good code and how to design good software.
That his how cerebral atrophy must feel like.
If you forgot to write good code and good architecture, in a span of what, at most, a year, then you were never a good engineer to begin with.
I was worth every penny I earned 4 years ago. 1 year ago, I had to open documentation for C++ features I use for a decade. I could not remember how it works.
Your brain is a muscle, and sure, I had more time to teach, but I got worse at teaching because I got worse at doing
I’ve been using oh-my-pi agent harness with a mixture of Claude for planning and either Gemma4 or Qwen3.6 for execution.
How do you get your LLM credits? Or do you run Gemma and Qwen locally? With which hardware?
For Claude I have the lowest tier subscription through work. I also have openrouter to use occasionally when I need it. Gemma and Qwen I run locally on a strix halo framework desktop I bought just before ram prices went to the moon.
. Gemma and Qwen I run locally on a strix halo framework desktop
So, CPU only?
No, Strix halo is AMD’s integrated CPU GPU using unified ram. Its the non apple tax equivalent of the mac minis people have been using to run local models. On one hand its a bit slower as it has lower memory bandwidth and that’s the limiting factor, but on the other its less than half the price for more memory and runs linux rather than osx.
