Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • zutto@lemmy.fedi.zutto.fi
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    This dwarfstar looks interesting, can you elaborate on your setup and what kind of inference speeds you are getting?