Possible that they are unable to distinguish between bullshit and reality? It would somewhat excuse their own bullshit: they may not know they are bullshitting.
I've often seen this phenomenon at play in religions. They are not intentionally lying even when they put forward outrageous claims; they genuinely believe what they say.
I once went to a conference about a company selling MLM products (I didn't know they were selling MLM products and I was young enough to not know about MLM). They were eating their own dogfood there, and lunch was free. It was at an expensive hotel in my country. There were loads of yuppies there. Everyone wore a suit.
Despite that, the conference felt as if I was at a cult. And the CEO knew I had a couple of questions about his products. He gave me the death gaze / cold stare during a speech. I was in my early 20s, scared shitless.
Now, remember I wrote the conference was as if I was at a cult? I got invited to this conference via a brother of an aunt (cold side). He used to be in a cult. Now he was a hardcore Christian. He got very rich from these MLM products because he was high up in the chain. As they say: the apple doesn't fall far from the tree.
He's not a salesperson; he's a Harvard Med School professor. But he made a fraudulent $700 million dollar sale (of his company), and escaped having it reversed because he managed to convince the court that he really believed his false claims and bogus research.
This is also the claim that SBF's lawyers are (still) making, now in the sentencing phase.
Elizabeth Holmes, and worse, some of Theranos' proponents still to this day believe the legal system "robbed" the world of the genius revolutionary change in medical labs that was "within reach" when Theranos cratered.
Well, can we really ascribe belief to the machine? And they don't usually have a bias in hallucination other than what you're feeding, salespeople absolutely do have a bias
Sure, just so long as you don't require beliefs to have qualia.
I'm fine with that myself, my beliefs only have qualia when I actively introspect them, but I'd still call them "beliefs" even before I examine them for the first time.
> And they don't usually have a bias in hallucination other than what you're feeding, salespeople absolutely do have a bias
The motivation may be different, even alien, but I'm not sure it matters. You can also tell an LLM to take on the role of a motivated salesperson, and it will role play that just as "happily" (if you'll excuse the anthropomorphisation) as any other.
Does that mean hallucinating LLMs will make great sales people?
Forget I asked. If you aren't careful about the places you inhabit on the internet most of what you'll read is generated by an LLM. If we aren't already there, we must be close.
Sounds like cognitive dissonance. It's easy to believe that BS is bad, but hard to recognize BS in others without also recognizing it in yourself. When those beliefs are in conflict the easiest resolution is to stop recognizing BS.
As they say: it's hard for a man to understand something when his paycheck depends on not understanding it.
