• FaceDeer@fedia.io
    link
    fedilink
    arrow-up
    5
    ·
    7 days ago

    There’s a fine-tuned version called Swift that’s been trained to use 58.3% fewer reasoning tokens, apparently with almost no loss of quality. I’ve not been in a hurry with my personal usage (I set my coding agent loose on a task and then go have tea or whatever) so I haven’t experimented with it much but it might be worth checking out if the verbosity of reasoning is a problem.

    Qwen4 will be coming out soon too, it has a 27B version, so perhaps they’ll have incorporated more efficient reasoning into it from the start. I’m looking forward to testing it out.

    • Hazzard@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      7 days ago

      Good tip! I’ll definitely be checking this out, as someone who also uses Qwen3.8 27B. The capability leap over the model I used before is definitely worthwhile, but wow does it overthink really easily.