Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • JustTesting@lemmy.hogru.ch
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 hours ago

    10 tests per model seems like way too little and they should give confidence intervals…

    the 10/10 vs. 8/10 is just as likely due chance than any real difference. But some people will definitely use this to justify model choice.