What Dot.com Bandwidth Taught Me About the AI Token Cost Panic(axamy.com)

2 pointsby jhonovichw zeszłym miesiącu2 comments

What Dot.com Bandwidth Taught Me About the AI Token Cost Panic

https://www.axamy.com/blog/bandwidth-tokens

2 comments

marekfulw zeszłym miesiącu

What made you think we'd ever need AI tokens as much as we do bandwidth, or that they are even comparable.

Bandwidth is abstract, it's information flow. LLMs are a specialised tool, they are based on noise and randomness, and thus are inherently imperfect.

We could have guaranteed the elimination of famine world-wide for 100 years from the resources we wasted on the AI infrastructure in the last 5 years. Shame on us.

There's usefulness in LLMs but not that much. They are definitely not the future.

phillipseamorew zeszłym miesiącu

Bandwidth usage isn't bound to power cost, e.g. a 10x increase in BW between NY and LA doesn't use 10x more power or likely even increase running costs outside of what could be called noise. Token generation however is more or less tied to power costs. There is nothing comparable between the .COM and AI bubbles and the likely outcomes.