Currently? 4-5 months “playing” with local models and in the last week or two it has REALLY started to come together, and I have NEVER in like 25+ years of having a home lab/server(s) under the desk, but as happy or impressed. Fully offline and private, scratch-coded agent with a boatload of models behind it, spread across five GPUs in four VMs, and now with fully private/local (also scratch coded) voice interface. Absolute most incredible thing I have put together in my life, and that’s not a short list of ‘cool shit’ I’ve built over the years.
Historically? Having such high-end networking gear to ‘play’ with in the early 2000s that I actually sold and shipped some to a small ISP overseas to use for production 🤣
Currently? 4-5 months “playing” with local models and in the last week or two it has REALLY started to come together, and I have NEVER in like 25+ years of having a home lab/server(s) under the desk, but as happy or impressed. Fully offline and private, scratch-coded agent with a boatload of models behind it, spread across five GPUs in four VMs, and now with fully private/local (also scratch coded) voice interface. Absolute most incredible thing I have put together in my life, and that’s not a short list of ‘cool shit’ I’ve built over the years.
Historically? Having such high-end networking gear to ‘play’ with in the early 2000s that I actually sold and shipped some to a small ISP overseas to use for production 🤣