Not everyone can run a 300B model on their own. Although, self hosting an OSS webui that talks to the API instead of opening their client (chatgpt.com) has proved viable
Oh so you use chatgpt (or open source models) via them? Are there privacy guarantees and what about uncensored models. We are spiraling into times where asking who owns that big piece of land next to Canada might be highly controversial
That’s what small models with tool calling abilities are for (beside the obvious advantage of live information). Sometimes it works like a charm, sometimes not.
Who the fuck still uses ChatGPT when there are so many open source alternatives that are much cheaper and sometimes even better overall?
Cheaper than free? Cause I haven’t paid a cent to them
Can you give some examples?
I don’t think they’re open source, but I use DeepSeek (Chinese) and Le Chat (French). I’m also testing out Lumo by Proton.
Not everyone can run a 300B model on their own. Although, self hosting an OSS webui that talks to the API instead of opening their client (chatgpt.com) has proved viable
Yea that’s why things like https://openrouter.ai/ exist.
Oh so you use chatgpt (or open source models) via them? Are there privacy guarantees and what about uncensored models. We are spiraling into times where asking who owns that big piece of land next to Canada might be highly controversial
That’s what small models with tool calling abilities are for (beside the obvious advantage of live information). Sometimes it works like a charm, sometimes not.