I propose a litmus test: "Would it be okay if this LLM was actually a client-side tool, trained and hosted on the user's machine?"
This framing helps highlight that (A) the data used to train and configure it is not reliably secret, and (B) a determined user can manipulate its output to fit their own goals.
The Strengths, Weaknesses and Dangers of LLMs · HackerTrans
This framing helps highlight that (A) the data used to train and configure it is not reliably secret, and (B) a determined user can manipulate its output to fit their own goals.