No, I’m not complaining that chatgpt is shit at reasoning - I’m demonstrating it.
I’m complaining that literal trillions of dollars plus environmental resources are being poured into this fundamentally flawed technology, all while fucking up the job market for entry level applicants.
Only three if I’m being honest, and none of them technically competent, so I’ll admit that you have a point here. I’ll just add that I assume that Sam Altman had something different in mind when he made that claim.
🤣
I love it!
What were the steps? We might need them in the future 👀
These models have to analyse and understand the meaning of a prompt rather than what is strictly said
Well, it clearly fails at that, and that’s all I’m saying. I really don’t understand what you’re arguing here, so I’ll assume it must be my poor grasp of the language or the topic.
That said, I salute you and wish you safe travels 👋
The machine thinks that 7 trips are needed to cross the river, because it doesn’t understand the question. Readers with actual comprehension understand that only one trip is needed, because the question is not a riddle, even though the it is phrased to resemble one.
Ah thank you, now I see what you mean. And it seems like we’re mostly talking about the same thing here 😅
To reiterate: unprecedented amounts of money and resources are being sunk into systems that are fundamentally flawed (among others by semantic drift), because their creators double down on their bad decisions (just scale up more) instead of admitting that LLMs can never achieve what they promise. So when you’re saying that LLMs are just fancy autocorrect, there’s absolutely no disagreement from me: it’s the point of this post.
And yes, for an informed observed of the field, this isn’t news - I just shared the result of an experiment because I was surprised how easy it was to replicate.
I mean, this is just one of half a dozen experiments I conducted (replicating just a few of the thousands that actual scientists do), but the point stands: what PhD (again, that was Sam Qltman’sclaim, not mine) would be thrown off by a web search?
Unless the creators of LLMs admit that their systems won’t achieve AGI by just throwing more money at it, shitty claims will prevent the field from actual progress.
But these systems work on interrupting the user’s input
I’m not entirely sure what you mean here, maybe because I’m not a native speaker. Would you mind phrasing that differently for me?
That’s got nothing to do with “PhD” level thinking, whatever that’s supposed to mean.
Oh, we’re absolutely in agreement here, and it’s not me that made the claim, but what Sam Altman said about the then-upcoming GPT 5 in summer. He claimed that the model would be able to perform reasoning comparable to a PhD - something that clearly isn’t happening reliably, and that’s what this post bemoans.
It’s just fancy autocorrect at this point.
Yes, with an environmental and economic cost that’s unprecedented in the history of … well, ever. And that’s what this post bemoans.
Really looking forward to being the single human thats made responsible because I didn’t catch all the bullshit before production.
Just recently we had some google guys at my workplace to hype up the hype some more. One of our leadership (they’re honestly great people) asked about the risk of obscuring the learning of our junior developers (by not hiring them), so that in a few years we’d have no seniors to verify the bullshit. The response was unironically that we’d need no seniors in a few years 😄
Ignoring for a moment that apparently women don’t exist in that world, even the premise doesn’t hold: Bad times don’t make hard people, bad times make sick, malnourished, badly educated and/or desperate people, none of which is conductive to making the proposed following of the good times.
If any of that were true, the good times in the so called first world should’ve made their peoples so soft compared to the hard peoples that should’ve been created literally everywhere else that the last 300 years of war or so should’ve ended very differently.
It’s a racist propaganda trope that harkens back to ancient Rome where senators decried the “soft” Roman lifestyle compared to the “hard” germanic tribes and has gathered connotations of blood-and-earth (“Blut und Boden”, no idea how thats translated) and other unsavory shit in the meantime.
I like to call it the “Fremen Mirage” after the awesome blog collection of a historian I very much like: https://acoup.blog/2020/01/17/collections-the-fremen-mirage-part-i-war-at-the-dawn-of-civilization/
Props to grindr for judo-ing this pile of worms to a place the original poster presumably wouldn’t have liked very much
No idea why OP did it, but for me it demonstrates that the claims of techbros that these LLMs are working on a reasoning level comparable to PhD, is wildly exaggerated. It puts into question if spending literal trillions of dollars for this crap is a good idea, when 250 billion (inflation adjusted) could build the large hadron collider, or a meager 25 billion a year could prevent world hunger.