I can imagine, sounds like you're doing interesting and challenging stuff, best of luck. And yes thank you! You confirm some thoughts I had and clarify others. I appreciate it
We're looking into fine-tuning and using 7B and 13B models and while we understand most of the mechanics we are somewhat overwhelmed by the amount of options available and are unsure where to start.
Do you recommend any open source frameworks for fine-tuning and running models?
Additionally, are you open to and available for consulting in this area?
I feel like the AI hype is putting people off but I do see genuine value being created in all kinds of places.
major: chatgpt for answering questions, explaining topics and helping with coding has brought me personally massive ROI
minor: a lot of companies are integrating LLMs to upgrade their offerings and a lot of small SaaS now exist due to LLMs. I have to guess at least some of those have a positive ROI