Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar’s mic if the TV doesn’t have one. Then OpenAI banned him for reverse-engineering it.
Source:
Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar’s mic if the TV doesn’t have one. Then OpenAI banned him for reverse-engineering it.
Source:
You should get very fast inference with Qwen 30B on that rig.
A huge problem in this space is that popular inference engines are… generally awful, tech bro slop, and the best ones are in the obscure DIY/hacking realm. The experience you’d get doing a default “Ollama run” vs a tuned rocm exllamav3/vllm setup or something is like night-and day; think 4 tokens/sec of jibberish, vs 40 tokens/s that performs close to unquantized.