Nah, LLMs are pretty useful for a wide range of tasks. I would grant them the status of “locally intelligent for text manipulation”. They can find patterns, transform, compress, and even generate text pretty well if you formulate the prompt correctly.

The problem with them is two-fold:

1. There is no actual grounded intelligence involved and yet they are used for all sorts of tasks where it is required, like research or decision-making or software architecture or creative writing.
2. They also captured human emotional states really well, which makes them scarily addictive for people looking for human connection (see all the “companion” chatbots) and terrifyingly useful for pushing propaganda, misinfo, and scams. This also multiplies the first problem tenfold because LLMs are trained to come off as confident which means they will “pretend” to be good at things they really are not, and if you don’t know how the underlying tech works you can be lulled into believing its confidently incorrect research results or execute a totally insane decision it makes.