Saw Wendell do this on the latest GN video and for some reason just knew it needed to be a thing.

    • xbloodymajor@reddthat.com
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      23 days ago

      I like to think of it like solar panels. Sure at first it takes a lot to make, but over time it evens out. I was pretty clear local AI is still morally grey at best, but its a real solution to some problems, an I would argue its better to have local control and use small energy efficient models to do assisting tasks than let the open AI’s of the world decide for us.

      • nixos_fan@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        3 days ago

        It’s strange to think selfhosted models are systematically more efficient than cloud hosted ones, have you never heard of economy of scale? Of batching?

        • xbloodymajor@reddthat.com
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 day ago

          Part true but don’t forget, an ai data center is only used for one purpose. Local ai can be used on an existing device that does other useful tasks.