• architect@thelemmy.club
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    18
    ·
    5 days ago

    No they hallucinate because they lose context but are tasked to answer anyways. They also don’t really lose context as much as they did a year ago.

    Their training data has nothing to do with it unless you’re using a local one without web access.

    • Zaktor@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      2
      ·
      4 days ago

      ML is my career and I’ve been doing it for decades. You’re wrong. LLMs hallucinate with full context.

        • Croquette@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          4 days ago

          ML is still very useful and used everyday. LLM could have been a nice tool in niche applications, but instead, big capitalists ruined that for us, and torching the environment and wrecking the economy with it instead.

          • Nate Cox@programming.dev
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 days ago

            Oh yeah ML still has a place for sure, it just doesn’t have the bizarre excitement because it’s actually hard to do.

    • SnoopSqueak@lemmy.today
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 days ago

      Their training data has nothing to do with it unless you’re using a local one without web access.

      Did you know that the ones you access online are also trained?

      Did you know that any chatbot that can connect to the web was given that capability?

    • Muehe@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      4 days ago

      No they hallucinate because they lose context but are tasked to answer anyways.

      Nothing to do with context. Context windows are an LLM specific thing, but all neural networks no matter the kind or size “hallucinate” because they are a piece of linear algebra where you put numbers in on one side and get numbers out the other.