We (a small startup) have recently seen considerable success fine-tuning LLMs (primarily OpenAI models) to generate data explorations and reports based on user requests. We provide relevant details of data schema as input and expect the LLM to generate a response written in our custom domain-specific language, which we then convert into a UI exploration.
I'm curious if anyone has explored similar approaches in other domains or perhaps used entirely different techniques within a similar context. Additionally, are there ways we could potentially streamline our own pipeline?