Ran some experiments to see how different things affected the quality of results from a retrieval-augmented generation (RAG) pipeline. Post shows results and details / code for how to run similar experiments yourself.
Author here. When I started hearing about Generative AI, I was really excited about the potential for "always on" agents eagerly assisting me rather than passively waiting for the next question. I wrote this blog-post as I've been thinking about what it will take to build such agents, that watch everything happening in real-time and proactively help.
Curious what others are thinking in this space. Have you been thinking about using AI in a real-time manner? What kinds of proactive agents would you like to see?
In this post, Therapon and I dive into a bunch of temporal queries showcasing some really powerful concepts -- using multiple event streams in a single query, creating windows delimited by properties in the data, and performing temporal joins.
The most interesting thing about timelines to me is how naturally they work at multiple layers. This post shows how well they can be used for understanding values over time. But we'll see that the same requirements we discuss -- that data is ordered by time and grouped by entity -- make them a natural fit for expressing queries and implementing efficient, incremental execution.
We'll be around -- if anyone has questions or thoughts please share!
Interesting that you mention DSLs like Drools and Esper. One of the things we'd like to do is explore ways to bring the complex/composite event-processing (CEP) functionality to Kaskada. SQL does include "match recognize" at this point, but it is still pretty unwieldy to use.
With the shift towards general event-processing, we'd really like Kaskada to make it easy to express queries like "how many times do X happen within an hour after Y with these properties" -- the kinds of things that Drools and Esper provided!
Looking for: Full-time engineers for full-stack web-application and data-processing backend
Kaskada is a Seattle-based startup revolutionizing enterprise machine learning through the use of real-time data. Our team is delivering an end-to-end machine learning platform powering feature engineering and productionization. We are hiring for mid-level and senior engineers for our frontend and backend teams.
As a member of a small startup, you will define and implement a new, interactive experience enabling data scientists to design, visualize, and collaborate on new features for their machine learning models.
Looking for: Full-time engineers for full-stack web-application and data-processing backend
Kaskada is a Seattle-based startup revolutionizing enterprise machine learning through the use of real-time data. Our team is delivering an end-to-end machine learning platform powering feature engineering and productionization. We are hiring for mid-level and senior engineers for our frontend and backend teams.
As a member of a small startup, you will define and implement a new, interactive experience enabling data scientists to design, visualize, and collaborate on new features for their machine learning models.