• fibojoly@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    19 days ago

    Yeah, I can see that but it’s horrendously slow, I find. I tried a 3.8 online and I just dont’ like the way it works, overall :( It goes on and on and on and never stops to ask despite that being one of my main rules.

    • FaceDeer@fedia.io
      link
      fedilink
      arrow-up
      5
      ·
      19 days ago

      There’s a fine-tuned version called Swift that’s been trained to use 58.3% fewer reasoning tokens, apparently with almost no loss of quality. I’ve not been in a hurry with my personal usage (I set my coding agent loose on a task and then go have tea or whatever) so I haven’t experimented with it much but it might be worth checking out if the verbosity of reasoning is a problem.

      Qwen4 will be coming out soon too, it has a 27B version, so perhaps they’ll have incorporated more efficient reasoning into it from the start. I’m looking forward to testing it out.

      • Hazzard@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        18 days ago

        Good tip! I’ll definitely be checking this out, as someone who also uses Qwen3.8 27B. The capability leap over the model I used before is definitely worthwhile, but wow does it overthink really easily.