staticcaucasian

先月議論

messenger is an absurdly popular app that keeps users in the platform and also increases the intensity of their usage, ultimately leading to more eyeballs, ads and revenue. If you look at it that way, relatively small features, and by association, improvements to the effectiveness of those features by a couple of SWEs each, gets you tons of business impact.

staticcaucasian

4 か月前議論

When it launched we all talked about the serving/inference costs being massive. In hindsight if they had a paywall, it might not have self-imploded so fast, might have stayed aspirational, and they might have a profitable business today. Interesting case study.

staticcaucasian

昨年議論

Does this actually need to be local? Since the chat bot is open to the public and I assume the course material used for RAG all on this page (https://canvas.illinois.edu/courses/54315/pages/exam-schedul...) all stays freely accessible - I clicked a few links without being a student - I assume a pre-prompted larger non-local LLM would outperform the local instance. Though, you can imagine an equivalent course with all of its content ACL-gated/'paywalled' could benefit from local RAG, I guess.

コメント