“A lot of generative AI stuff isn’t really working,” Gownder said. “I mean, enterprise, and I’m not just talking about your consumer experience, which has its own gaps, but the MIT study that suggested that 95 percent of all generative AI projects are not yielding a tangible P&L benefit. So no actual ROI. McKinsey has something like 80-something percent that don’t.
I feel this very strongly as well. Whenever you do something yourself there’s a natural self-reinforcement mechanism. It’s how people learn (something no LLM can do). This is why people retain information better when they take hand written notes. Having notes to reference back to is nice, sure, but the actual act of taking the notes is the thing that really drives enforcement learning. You’re forcing yourself to build connections in your brain that you don’t get just from passively listening.
AI assisted coding takes the self-reinforcement out of the process completely and you end up with code that you might marginally understand right now… but in 3 weeks? 3 months? Yeah, not so much.
I notice that in driving, using maps features I do not recall enough to reliably retrace steps, while finding it the old way I do.