Kimi K3 still trails Anthropic’s Claude Fable 5 and OpenAI’s GPT 5.6 Sol on overall performance, the company said on Friday, but consistently outperformed other tested models.
The model beat Claude Opus 4.8 and GPT 5.5 — models that sit just behind Anthropic and OpenAI’s leading-edge systems — on benchmarks including coding and general agents, according to Moonshot.
It’s China’s largest AI model so far, with 2.8 trillion parameters, referring to the size of its neural network.
How big is un-quantized 2.8t param model?
I just got some hardware but I still don’t have a ton of vram :(
Its trained at native MXFP4 with MXFP8 activations layer, so you need around 1.5TB of VRAM to fully offload it without taking into account the context cache. It might be doable to do some smart expert offloading and swapping, but expect minimum 500GB of VRAM and 1TB of system RAM minimum and the t/s would be reduced.
Its only realistically runnable on datacenter grade gpu at decent speed for now (and judging from the price of ram for the next few years)
Hobbyists are working in the billions or tens of billions. Trillions is insane. I’m sure some people can run it, but not many.
I know a guy who found a way to monetize his GPU, just really slowly. He did it until he was able to buy 2 more, then 4 more, and so on. He has like 90 now. I’m sure he could if he wanted to.
deleted by creator