For instance used it in conjunction with llama-index for knowledge management. Created an index for a whole confluence/jira of a mid-sized company, got good results with GPT, but for LLaMA of this size that use case was too much.
I tested on a serious use case and quality was subpar. For real use cases I had to either host the most powerful model you can get (e.g. LLaMA-65B or so) on a cloud machine, which again costs too much (you'll be paying like 500-1000 USD per month), or just go straight for GPT-3.5 on OpenAI. The latter economically makes most sense.
yea, you're right. It's really pre-MVP. Basically an API in between your user facing input and OpenAI that detects prompt injections and flags them for you so you can abort sending to OpenAI.
I know an amazing IC at a software company I once worked at that I still keep in touch with. He has extremely deep technical knowledge, which you can simply deduct from basically everyone in the company (even from other teams) coming to him for advice. He's been at the company for >10 years.
He has strong opinions on current processes and just getting things done.
This post resonated deeply with me, since I've discussed before with him his role and how it could evolve. I know for a fact that he dislikes lots of meeting and really likes working on the core product, and so far hasn't really jumped on the opportunity to go into management - he doesn't really want to be manager. So he is kind of exactly the guy the post is describing. The company is growing though and he is very slowly getting pushed by the head of development into a more managerial role..
Let's see how it works out. I believe he is going to be a great manager though.
To add to this, as a German, the future of Uber does not look great in Europe as well. The taxi lobby is strong here, and I’m sure regulations will come in countries like Germany and will affect negatively their business. And they're starting to face stronger competition from other companies like Bolt.