The fact that it lies is so irritating, if it at least admitted that it didn’t know the answer it would at least be a useful search engine. The fact that it makes stuff up though means I always have to scroll past the AI summary, that I didn’t ask for, in order to actually go to the website to check the results myself, because I can’t trust it.
The worst part is that mostly lies for things that aren’t immediately obvious, so you ask it “what is the color of the sun” and it appears to work just fine, but the moment you use it for any real research, it will just fabricate things wholecloth.
thats completely false when you only ask the llm a very basic question like “what color is the sun?” you need to talk to the model like its smarter than a google search engine. “what color is the sun? pull the data from scientific articles and other sites that study the sun”
if you google the first question, you will have list of different pages, where if you use AI to search on your query, it will model an answer from thoese sources, with said sources linked, similar to a Wikipedia page.
There are thousands of papers on the color of the sun, its trivial to google a paper, if you need an LLM to do this, that’s on you. But if you ask it valve clearances for an indonesian motorbike in english, it will make it up, even though the service manual is available in Indonesian. If you ask it how to synthesize a chemical that nobody bothers to write about because its uninteresting or impossible, it will straight up lie.
What kind of research do llms actually help with?
In my experience, if the answer can’t be found in the top google results, the AI simply makes shit up.
The fact that it lies is so irritating, if it at least admitted that it didn’t know the answer it would at least be a useful search engine. The fact that it makes stuff up though means I always have to scroll past the AI summary, that I didn’t ask for, in order to actually go to the website to check the results myself, because I can’t trust it.
The worst part is that mostly lies for things that aren’t immediately obvious, so you ask it “what is the color of the sun” and it appears to work just fine, but the moment you use it for any real research, it will just fabricate things wholecloth.
thats completely false when you only ask the llm a very basic question like “what color is the sun?” you need to talk to the model like its smarter than a google search engine. “what color is the sun? pull the data from scientific articles and other sites that study the sun”
if you google the first question, you will have list of different pages, where if you use AI to search on your query, it will model an answer from thoese sources, with said sources linked, similar to a Wikipedia page.
There are thousands of papers on the color of the sun, its trivial to google a paper, if you need an LLM to do this, that’s on you. But if you ask it valve clearances for an indonesian motorbike in english, it will make it up, even though the service manual is available in Indonesian. If you ask it how to synthesize a chemical that nobody bothers to write about because its uninteresting or impossible, it will straight up lie.