Re: Hallucinated citations are polluting the scientific literature. What can be done?
The True Melissa <[email protected]>
| Newsgroups | sci.edu,comp.ai.philosophy,alt.books,alt.politics.media,rec.arts.books,misc.writing |
|---|---|
| Organization | n/a |
| Message-ID | <[email protected]> |
Verily, in article <[email protected]>, did [email protected] deliver unto us this message: > I usually tell people the following about LLMs: > > Ask it questions about a subject you know well. See how long it takes > it to tell you sonething inaccurate. Ask yourself if you'd have caught > the mistake if you didn't have the knowledge you do. Finally, ask > yourself: do you still trust the LLM? > It's a handy exercise, but I'm not sure how much it would help. Confidence is such a useful trick to sucker humans. I once saw a study which said that we weigh confidence more heavily than a person's actual track record when deciding whether to believe. It works just as well on other humans. I recently read a book which included a survey of an impact on the various arts, and when I got to the music section, I realized the writer wasn't very well informed. For no rational reason, the sections about which I knew less still felt convincing. -- The True Melissa - Canal Winchester - Ohio United States of America - North America - Earth Solar System - Milky Way - Local Group Virgo Cluster - Laniakea Supercluster - Cosmos