Does the LLM also reside on the local machine? I presume there would need to be something to manage the transcription and address queries related to that transcription. It seems like the LLM would require a reasonably extensive context window to be functional. Wouldn’t this necessitate a relatively powerful computer? I am definitely not an expert on this so I could be completely off target on one of these assumptions.. genuinely curious though.
It is possible that the parameters, like weights in a machine learning model, interact to yield outcomes in a manner analogous to the interactions between genes in biological systems, which produce traits. These interactions involve complex interdependencies, so there really aren't 1 to 1 dials.