• GamingChairModel@lemmy.world
    link
    fedilink
    arrow-up
    10
    ·
    2 days ago

    Yeah.

    The groundbreaking “Attention Is All You Need” paper, in which transformer architecture was proposed, was published 9 years ago. It was obviously part of a much longer running conversation around how to use linear algebra to find machine learning applications. If you’re looking for someone who understands the underlying math and processes at a lower level, this isn’t an unreasonable ask.

    It is, however, an unreasonable ask of someone for a “prompt engineer” job though.

    • socsa@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 days ago

      Ironically, I have literally implemented backpropagation from scratch like three separate times at this point (once before the famous CUDA impl) but I’d probably fail this interview for not knowing enough of the current agentic meta.