The Jassy "Thoughts on Gen AI" memo was released a month ago and this article doesn't seem to reveal any new information on this beyond just suggesting "amazon might soon reduce cost to serve" without providing any real information https://www.aboutamazon.com/news/company-news/amazon-ceo-and...
Tried to link to the specific timestamp in the video, where the p99 lie is discussed. Core takeaway for me was that most users of a page will experience the p99 latency of the system: https://youtu.be/lJ8ydIuPFeU?si=HasLt5QBsB1tzww_&t=648
> Amazon is using math to help solve one of artificial intelligence’s most intractable problems
Seems like pretty bad way to start this article off. AI is math at the end of the day how is this special.
Generally the article seems to lack a lot of substance or specifics on what or how effective automated reasoning is at improving results. Actual substantive studies/papers might be more interesting...
I liked how many of these solutions were pretty "simple" and easily applicable to many engineering teams. Our team similarly saved a ton by just "right-scaling" our AWS resources, applying TTL where possible.
Sorry, yeah I was a bit unclear. I was curious if there was any metrics to show how maybe server CPU/Memory or client-side latency changed after moving your app to Rust and running for a year.
But that's fair, if adding open-telemetry is maybe overkill to add to the application it might not apply as much to your use-case.
Nice article, but was looking forward to more of the "in production" angle (e.g. more operations, monitoring, performance). Instead this seemed to more focus on the the maintainability, developer experience using Rust and the ecosystem.
I love CarPlay/AA, and maybe this is hyperbole but not doing CarPlay/AA isn't that crazy of a decision. Tesla, GM, other big automakers have done this too.