• h0tbeef@lemmy.zip
    link
    fedilink
    arrow-up
    2
    ·
    8 hours ago

    The GPUs designed for inference (slop) are not the same kind of GPUs that run video games either.

    Here’s an article explaining why HBM is really difficult to integrate into a real computer, and why doing so would eliminate nearly all of the advantages of using HBM (while failing to eliminate the things that make HBM much more expensive to both produce and power than regular DRAM).

    Your proposed “worst case” scenario would be far better than reality’s “best case” scenario.

    (The real best case scenario would have been to not build all this worthless bullshit in the first place, but its too late for that).