Looks a lot like a straw man to me.

I don’t hate all LLMs/ML models/“AI”.

I also don’t use them. I also don’t see a need to use them.

I work in tech and these “AI” things are little more than averaging the most common replies to a given input. Any question that’s been asked, especially those that are asked often, is well suited for an LLM chat bot. That’s good if you want a high level overview of a topic that you don’t know much about. If you want accuracy, you’ll need to dig a bit more, but overall, you’ll get a relatively good idea of the answer you’re looking for. That’s enough for most people.

I’m crazy. I like to deeply understand everything, so the high level, lack of detail, finesse, and accuracy of LLM chat bots is unacceptable for me, so I trend towards doing my own research. If I use an LLM at all, it’s just an augmented search engine. I’m more interested in its references than its response.

There’s also something to be said about making short clips of impossible things that some smaller YouTubers are using “AI” models for. Things that would take a long time for a graphics artist to create, and an editor to composite. Stuff that a small time YouTuber can’t really afford, but they can get good enough but clearly “AI” visuals to spice things up in their videos. The AI is just for display during transitions, it doesn’t affect the content being made in any meaningful way. I’ve seen Paul Hibbert do this a lot and his production team from what I know is basically him and his wife. I’m not even sure if he has an editor, or if he does it himself. He’ll go from a live shot of him talking about a product, do an AI transition, to another live shot of him continuing his discussion. Rather than a cut, or some kind of fade, wipe, or other simplistic transition, the generated images are of him, and only to add visual flavor. He also does some AI generated music stuff, which again, fair. He’s not exactly a musician, and unless he has the money to hire a musician, he either uses AI for the funny transition music or he uses an unrelated and unlicensed (or open licensed) song… It just adds flavor to his content, it builds on what he’s creating, it doesn’t shape what he’s creating. All of his scripts sound genuine, not AI created, so everything should be fine.

That, to me, is a good use of AI as a tool.

There’s too many bad examples for me to really cover them in any detail, but I’m sure everyone has seen the AI generated person being animated by AI, reading an AI generated script, using an AI generated voice sample. Even if the original source material is legit, is buried under so many layers of slop that I can’t bear to watch it.

For me, it entirely depends on what he’s using it for. It’s entirely not about the fact that he uses it. I’ll have to dig into it a bit to see what he’s doing, but from the comments I’ve read so far, it seems like the answer to what he’s using it for, is yes. He’s using it for everything… Not ideal.

some AI coprocessors, you’re right. they can’t be used.

Most of what nVidia is offering, while lacking display outputs, can still be used for gaming/VDI/vGPU use, and in general aren’t particularly bad at it, usually quite the opposite. might take a bit of work to get them going, and nVidia hasn’t made it easy with their whole licensing thing. Putting aside the challenges, it’s usually possible to adapt their SXM datacenter GPU modules to work with more common frameworks like PCIe, and then utilize those as virtual GPUs in a virtual desktop. This is not dissimilar to what they’re doing with the geforce now platform.

The big benefit of the chips is that they come with loads of memory, so cutting them up as a vGPU is actually a really optimal use-case. Most games are memory limited, which is to say they need more memory than most GPUs have, so the limit in performance is from the memory limitations, not the graphics processing limitations.

The AI processors that are GPU based, like almost everything that nvidia is using, can mostly be repurposed, but those that are ML-only, like AI coprocessors that show up in CPUs like the AI optimized CPUs from AMD and Intel, can’t really be re-used, but they’re usually not released as a standalone product. Those may still be able to perform physics processing offloads… so maybe not useless? I’m not sure.

Listen, I work IT at a managed service provider, which means I see a dozen + small to medium business environments daily.

The number of users that I know of, out of the hundreds or thousands that I support, who are actively using “AI” continually to do their jobs… Well, I can likely count them on one hand

There’s a bunch that use whatever free tool they are allowed to access. Which kind of flies under the radar for me, but I still don’t think you’re dealing with double-digit percentages of people using “AI” that actually spend any money on it.

And these are business users, who work at businesses with rather deep pockets at times…

People are not buying the product. “AI” in the business world, isn’t making any money. So from what I’ve seen, this is less a matter of if, and more a matter of when and how bad.

As a tech person, I am not threatened by AI. It can’t do my job. Also, I’m the one who fixes it when things go wrong. And the only thing I’m looking forward to is being able to pick up cheap RAM, and storage when this all comes crashing down as AI companies cash out and liquidate their inventory. Maybe I can pick up a cheap AI server and repurpose it to be a 3D/gaming virtual desktop, so when my friends come over with their cheap laptops and on board graphics for a LAN party, I can just provision them a virtual gaming computer and we can go ham…

I’m going to save my sheckles until then…

I have limited experience with the market but I see it this way: anyone with AI holdings should liquidate at their earliest convenience. I don’t think they’ll be keeping up this charade for a lot longer. Anyone who has tech holdings, either cash out, or be prepared to have that money held up for a while because it will take a long time for the prices to recover, and unless you want to cash out at a loss, you’re going to be holding for a long time. Everyone else, hold onto your butts. Probably everything will probably dip when the fecal matter hits the rotary air movement device. Non tech areas of the market should recover pretty quickly, so meh?

This is obvious to me that the whole thing has failed. That realization hasn’t hit execs yet.