I don't know about the US but in France (or Europe) the environmental impact of air conditioning, car driving and meat consumption is well understood by most educated people.
I'm not sure I understand. You realise that our token consumption in coming on top of our other energy/water consumption right?
Also, the environmental impact might be small if we run a small number of inference queries every day, but that impact will grow linearly with the number of queries and agents we run.
Is this Extism, but running as a service? https://extism.org/ It seems to me that a key feature of Extism is host functions (which can be called from the sandbox). But maybe I'm not comparing apples to apples?
I don't know about the US but in France (or Europe) the environmental impact of air conditioning, car driving and meat consumption is well understood by most educated people.