I'm very curious whether a) anecdotally, anyone has encountered a real enterprise cost-cutting effort focused on LLM APIs and b) empirically, whether anyone has done any research on price elasticity in LLMs of different performance scales.
So far, my experience has been that it's just too early for most people / applications to worry about cost - at most, I've seen AI to be accountable for 10% of cloud costs. But very curious if others have other experiences.
I love that the base model starts with 16GB of RAM here. The value of these computers is incredible - I purchased a Macbook Pro in 2021 and it's still powering through every task I throw at it. Before Apple started making their own chips, I felt like I had to upgrade every 2-3 years to prevent my laptop from becoming a hurdle in completing every day tasks (remember when tab management was a thing?). Really happy with these machines.
I'm curious if it might be possible that an AI "civilization", similar to the one proposed by Altera, could end up being a better paradigm for AGI than a single LLM, if a workable reward system for the entire civilization was put in place. Meaning, suppose this AI civilization was striving to maximize [scientific_output] or [code_quality] or any other eval, similar to how modern countries try to maximize GDP - would that provide better results than a single AI agent working towards that goal?
We currently make about $3K per month with https://www.hiyodel.com - ChatGPT-powered copywriting for Shopify stores. The Shopify ecosystem is a toughie and it's been a difficult road so far, but it's great having the "passive" income!
So far, my experience has been that it's just too early for most people / applications to worry about cost - at most, I've seen AI to be accountable for 10% of cloud costs. But very curious if others have other experiences.