• Shatur@discuss.tchncs.deOP
      link
      fedilink
      English
      arrow-up
      8
      ·
      11 days ago

      Interesting, I had the opposite experience. Especially for tool calls. But I heard it depends on the use case: Qwen better at coding and tool calls, Gemma is better for prose.

    • Bread@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      3
      ·
      11 days ago

      Like all things llm, the quantisation makes the difference. Which, of course you need the vram for to have good results. Flash next works very well if you can run the higher quants.