Stop using JSON for LLM structured output(nehmeailabs.com)
nehmeailabs.com
Stop using JSON for LLM structured output
https://nehmeailabs.com/post/structured-output-overhead
1 comments
For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.