Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • Urist@leminal.space
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 hours ago

    Language without meaning is garbage. Like, literal garbage, useful for nothing. Language is a tool used to express ideas, if there are no ideas being expressed then it’s just a combination of letters.

    Which is exactly why LLMs are useless.

    • Iconoclast@feddit.uk
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      4
      ·
      2 hours ago

      Which is exactly why LLMs are useless.

      800 million weekly ChatGPT users disagree with that.

        • Iconoclast@feddit.uk
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          edit-2
          59 minutes ago

          Something being useful doesn’t imply it’s good or beneficial. Those terms are not synonymous. Usefulness describes whether a thing achieves a particular goal or serves a specific purpose effectively.

          A torture device is useful for extracting information. A landmine is useful for denying an area to enemy troops.

      • Urist@leminal.space
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 hour ago

        Those users are being harmed by it, not benefited. That isn’t useful, it’s a social disease.