• SparroHawc@piefed.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    Except if you make the output token temperature too cold, it has a higher tendency to get stuck in loops and the like. A little bit of actual randomness is important.

    • wonderingwanderer@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 day ago

      That’s just adding noise, it’s not unique to AI. It’s also used in audio and visual design, and even cryptography.

      • SparroHawc@piefed.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        18 hours ago

        It’s not unique to AI, no, but no one said it was. My point is that the noise is important to the functioning of the AI - and makes it even less deterministic, which also makes it poorly suited to automation in critical systems.