Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby(aha.io)

13 pointsby hotk9 ay önce0 comments

Show HN: Incremental JSON parser for streaming LLM tool calls in Ruby

https://www.aha.io/engineering/articles/streaming-ai-responses-incomplete-json

Built this for streaming AI tool calls. LLMs stream function arguments as JSON character-by-character. Most parsers reparse from scratch each time - O(n²) behavior that causes UI lag.

This maintains parsing state, processing only new characters. True O(n) performance that stays imperceptible throughout the entire response.

Ruby gem, MIT licensed. Would love feedback.

0 comments

—