HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Sirupsen

no profile record

Submissions

Rust zero-cost abstractions vs. SIMD

turbopuffer.com
24 points·by Sirupsen·4 mesi fa·4 comments

SpacetimeDB: A Short Technical Review

strn.cat
9 points·by Sirupsen·4 mesi fa·0 comments

A distributed queue in a single JSON file on object storage

turbopuffer.com
171 points·by Sirupsen·5 mesi fa·55 comments

Vectorized MAXSCORE over WAND, especially for long LLM-generated queries

turbopuffer.com
4 points·by Sirupsen·7 mesi fa·0 comments

comments

Sirupsen
·5 mesi fa·discuss
Yep! Other than random reads (~p99=200ms on larger ranges), it's essential to get good download performance of a single file. A single (range) request can "only" drive ~500 MB/s, so you need multiple offsets.

https://github.com/sirupsen/napkin-math
Sirupsen
·5 mesi fa·discuss
Due to the batching, this will only consume a few million class B per month. They are $5/million
Sirupsen
·5 mesi fa·discuss
(cofounder of tpuf here)

We don't have a relational database, otherwise that would work great for a queue! You can imagine us continuing to iterate here to Step 5, Step 6, ... Step N over time. The tradeoff of each step is complexity, and complexity has to be deserved. This is working exceptionally well currently.
Sirupsen
·8 mesi fa·discuss
Our query planner has that built in! We've spent a lot of time making high recall with any selectivity in the fitler work.