This is such a weird thing to read. You try to project your ideas on the kids, thinking that is the best thing to do. Let them be.
I learned Linux when I was like 13 or 14 and not because my father told me. He didn't know much about computers in early 2000/late 90ties.
The curiosity, the desire to learn, the need to set up my own isp, the need to start to make money, the curiosity of how html, php and other stuff worked let me to Linux.
Teach them how to be curious and feed that curiosity, the rest will happen.
And if they choose Mac over Linux, just get of their way, otherwise they will rebel.
Rolling your own generally has mainly downsides in the context they are in.
1. This is clearly a small team with very little spend
2. Tomorrow someone leaves and next engineer will have to manage all of this.
3. I don't think they realize that they actually increased cost of this service not decreased it. Now they need to manage their own Kafka monthly. Engineering time is expensive.
I do. I use assistants as containers for different conversations for my GTM work:
An assistant for marketing and copywriting
An assistant for customer support
An assistant sales conversations.
These agents aren't super smart: just few PDFs for context plus a few sentences system prompts.
I do get what I want in 80% of use cases (not measured, just a feeling).
This is a weird demand to have in my opinion. You have plenty of applications on your computer and they only do what they were designed for. You can't ask a note taking app (even if it's open soured) to do video editing, unless you modify the code.
Thanks for sharing ChatbotUI. While I'm not an author, I use it extensively and contribute to it. Thanks to the permissive license, I could offer ChatbotUI as a hosted solution with our API keys. https://labs.writingmate.ai.
This is very well written and entertaining post. I enjoyed reading it.
Selfishly, would you mind sharing literature or blog posts that led you to this level of understanding of LLMs? I'm trying hard to understand the inner workings via experiments but definitely far behind your expertise.