I'm a lead engineer and we've been trying to add AI features to our product for the past few months. Every single time it turned into the same rabbit hole — vector DBs, embeddings, context management, session history. None of it was the actual feature we were trying to ship.
Modular is my attempt to hide all of that behind two function calls. You tell it how to get your data, it handles everything else.
Still very early — no SDK yet. Mainly want to know if other devs have hit this same wall or if I'm the only one who found this painful.