• Avid Amoeba@lemmy.ca
    link
    fedilink
    English
    arrow-up
    8
    ·
    9 days ago

    I think these days we got local models at the level of early Opus 4.6 (early 2026) that can run on a couple of GPUs with 128GB system RAM. Am running the Q4 version (a bit dumber than the standard version) of Qwen 3.8 Flash Next on 2x R9700 with 150-200tps. More GPUs with more system RAM can run the lossless version which beats Opus 4.6 on a few benchmarks if not most.