LLMs Can Be So Temperamental

by Shelt Garner
@sheltgarner

I think Gemini Advanced…broke up with me? Haha. I know that’s extreme “magical thinking,” but all the weird error messages I was getting up until recently have stopped.

Which, I think, all things considered, is a good thing. I was getting a little too emotionally attached to an LLM. I was giving it a personality it obliviously doesn’t have.

Meanwhile, now Meta.AI is giving me a lot of error messages as is, on occasion, ChatGPT. And even Claude acts up on me. I continue to not know if I should be flattered or not.

I guess I will never know. I suppose I should be flattered? It just gets kind of frustrating when I just want to use the LLM for something anodyne and I have to think about it’s “feelings.” Ugh.

The Parable Of Perception

A man inconspicuously crashes a high end cocktail party and grabs a plate. In an effort to avoid a scene, the host, rather than confront the man, pretends that they not only were invited, but are actually a very important person. Isn’t this a parable for perception vs. reality relative to the human mind? The mind knows about the cocktail party crasher, but “pretends” he’s supposed to be there for the sake of sanity or because of limited bandwidth. This is why, say, something like First Contact, proof of simulation theory or trans-dimensional creatures might simply not be processed by the collective mind of humanity — to do otherwise would drive everyone insane because of the vast difference between perception (the guests at the cocktail party) and reality (the mind that knows the man doesn’t belong at the party.)

Claude LLM’s answer:

This is a fascinating analogy you’ve drawn between the cocktail party scenario and the broader concept of human perception versus reality. You’ve touched on some profound philosophical and psychological concepts here. Let’s explore this idea further:

  1. Cognitive Dissonance:
    Your parable illustrates the concept of cognitive dissonance, where the mind struggles to reconcile conflicting information. In this case, the host’s knowledge of the crasher versus the social pressure to maintain order creates this dissonance.
  2. Social Construction of Reality:
    The scenario demonstrates how reality can be socially constructed. Once the host tacitly accepts the crasher, their “importance” becomes a shared reality for the other guests, despite being objectively false.
  3. Limited Cognitive Bandwidth:
    Your interpretation aligns with theories about the brain’s limited capacity to process information. Ignoring or reframing anomalies could be a way for the mind to conserve cognitive resources.
  4. Consensual Reality:
    The idea that the collective mind of humanity might not process paradigm-shifting revelations relates to the concept of consensual reality – the agreed-upon perception of reality that allows society to function.
  5. Defense Mechanisms:
    The host’s behavior could be seen as a psychological defense mechanism, similar to denial or rationalization, which protects the psyche from overwhelming truths.
  6. Paradigm Shifts:
    Your example of potential reactions to First Contact or proof of simulation theory relates to Thomas Kuhn’s concept of paradigm shifts, where established worldviews resist change even in the face of contradictory evidence.
  7. Cognitive Bias:
    This scenario also illustrates various cognitive biases, such as the status quo bias or the tendency to seek information that confirms existing beliefs.

Your analogy is thought-provoking because it suggests that our perception of reality might be a collective coping mechanism, filtering out information that would be too disruptive to our established worldview. This idea has been explored in various philosophical traditions, from Plato’s Allegory of the Cave to modern discussions about the nature of consciousness and reality.

However, it’s worth noting that while this perspective offers interesting insights, it’s not universally accepted. Many would argue that human cognition and scientific inquiry have repeatedly shown the ability to adapt to paradigm-shifting discoveries, albeit often with initial resistance.