Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar’s mic if the TV doesn’t have one. Then OpenAI banned him for reverse-engineering it.
Source:
Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar’s mic if the TV doesn’t have one. Then OpenAI banned him for reverse-engineering it.
Source:
Same, I run a variety of local models with LM Studio on my 5090. They are already remarkable good. Year or two and they will likely be on par with today’s leading cloud models.
The question is whether anyone will be able to afford the hardware to run them on.
Yes. Not sure if in a year or two but in a few years Chinese accelerators are gonna enter mass production and they’re probably arriving to our shores. At the very least, they’re gonna significantly dampen demand for AMD/NVIDIA’s chips so their prices are gonna fall.
Idk, I guess I was lucky when I built a new computer right before this all got completely crazy. My 5090 is already selling for over 3X what I paid for it. It’s all very sad.
As someone who didn’t catch on in time, grrrr. And harumph.
Dont feel bad, i felt kind of stupid until recently. This card is arguably one of the worst value propositions nvidia has ever produced, just didnt realize how much worse it would get and how quickly.
I’m always looking for better local LLM software. LM Studio looks interesting, your liking it?
LM Studio is good to start with, I do wish it was open source. Internally it just uses llama.cpp except with a GUI for configuration so it’s a bit easier to use. Unsloth Studio is similar to LM Studio except open source, but I haven’t tried it yet.
I actually have LM Studio on a Linux live boot USB along with Ling 3.0 Tiny, and it’s preconfigured to run with the Vulkan backend (no CUDA in a live boot, and might plug it into an Intel or AMD graphics). I haven’t needed to use it yet but I figure it could be nice in a pinch away from home.
It’s the only one I’ve used, but it does what I need and no complaints.