Hi all,

Decided I want to give Hermes a try, but man their documentation is horrid. So, for running fully offline, here’s their “guide”: https://hermes-agent.ai/how-to/run-hermes-offline

Now since that’s trash, anyone here actually doing this? Did you just remove all references to non-local providers in the config.yaml? Are you using other containers for TTS and STT? Any help would be appreciated as I dive in.

Thanks in advance.

  • Fmstrat@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    6 days ago

    Yea, connecting to my local llama instance was pretty straight forward. But then I realized there are still moe providers set up with openai and anthropic outside of the main providers, and then there are MCP tools and skills that don’t ask permission to use the internet, etc. Just seems like OpenWebUI gives you a lot more visibility and control.

    • pech@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 days ago

      Yeah I kind of got tired trying to manage all the changes the devs made to the harness, though the docs are explicit in saying nixos is a tier 2 platform lol.

      I’ve been using deepseek-harness for a few weeks and it’s been awesome