I’m spending a significant portion of my day waiting for agents to execute.
What’s more interesting to me than time-to-first token or latency is the time it takes for the agent to execute, from starts to finish, excluding when it’s waiting on a human.
Wow, Voxtral is amazing. It will be great when someone stitches this up so an LLM starts thinking, researching for you, before you actually finish talking.
Like, create a conversation partner with sub 0.5 second latency. For example, you ask it a multi part questions and, as soon as you finish talking, it gives you the answer to the first part while it looks up the rest of the answer, then stitches it together so that there's no break.
The 2-3 second latency of existing voice chatbots is a non-started for most humans.
This will destroy a lot of trust and between Apple and me.
When I buy Apple, I pay a premium price for a premium product.
The ways ads work, is that the ad revenue shows up in the company’s quarterly earnings, and very quickly the company has to increase ad load across every surface to meet earnings expectations. The user experience deteriorates, getting worse each year.
When I buy Apple, it’s based on my expectation that Apple will remain a premium, mostly ad-free experience for the life of the device. When, after my purchase, they make the product worse, like with the recent iOS update that rolled back usability, it destroys a lot of trust.
This will destroy a lot of trust and between Apple and me.
When I buy Apple, I pay a premium price for a premium product.
I would rather you simple charge me more for my product.
The ways ads work, is that the ad revenue shows up in the company’s revenue, and very quickly the company has to increase ad load across every surface to meet earnings expectations. The user experience deteriorates, getting worse each year.
When I buy Apple, it’s based on my expectation that Apple will remain a premium, ad-free experience for the life of the device. When, after my purchase, Apple make the product worse, like with the recent iOS update that rolled back usability, it destroys a lot of trust.
What’s more interesting to me than time-to-first token or latency is the time it takes for the agent to execute, from starts to finish, excluding when it’s waiting on a human.