• GamingChairModel@lemmy.world
      link
      fedilink
      arrow-up
      10
      ·
      2 days ago

      Yeah.

      The groundbreaking “Attention Is All You Need” paper, in which transformer architecture was proposed, was published 9 years ago. It was obviously part of a much longer running conversation around how to use linear algebra to find machine learning applications. If you’re looking for someone who understands the underlying math and processes at a lower level, this isn’t an unreasonable ask.

      It is, however, an unreasonable ask of someone for a “prompt engineer” job though.

      • socsa@piefed.social
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 days ago

        Ironically, I have literally implemented backpropagation from scratch like three separate times at this point (once before the famous CUDA impl) but I’d probably fail this interview for not knowing enough of the current agentic meta.