But we do own RAM, do they plan to buy all of it indefinitely? All sorts of other businesses still need computers so they will be buying them even if they cost more, and when they replace them the old ones can be sold off.
There is even the possibility of crowd sourced AI, I know AI horde exists although I think its pretty small and I haven’t touched it in a few years now.
So the problem here is that every machine would have to run an instance of some model, you can’t spread the model over all the machines. It’d be too slow. Reading from NVMe on your very own machine is already pretty slow as it is. Kinda limits the model size.
You can let others use your hardware and in return get higher priority to use others. Want to generate 20 images? Its quicker spread across several other peoples GPUs at the same time with the same prompt.
Not poked AI stuff in a while though, it was interesting from a technical perspective but overall not super useful to me.
But we do own RAM, do they plan to buy all of it indefinitely? All sorts of other businesses still need computers so they will be buying them even if they cost more, and when they replace them the old ones can be sold off.
There is even the possibility of crowd sourced AI, I know AI horde exists although I think its pretty small and I haven’t touched it in a few years now.
So the problem here is that every machine would have to run an instance of some model, you can’t spread the model over all the machines. It’d be too slow. Reading from NVMe on your very own machine is already pretty slow as it is. Kinda limits the model size.
You can let others use your hardware and in return get higher priority to use others. Want to generate 20 images? Its quicker spread across several other peoples GPUs at the same time with the same prompt.
Not poked AI stuff in a while though, it was interesting from a technical perspective but overall not super useful to me.