HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Sirupsen

no profile record

Submissions

Rust zero-cost abstractions vs. SIMD

turbopuffer.com
24 points·by Sirupsen·vor 4 Monaten·4 comments

SpacetimeDB: A Short Technical Review

strn.cat
9 points·by Sirupsen·vor 4 Monaten·0 comments

A distributed queue in a single JSON file on object storage

turbopuffer.com
171 points·by Sirupsen·vor 5 Monaten·55 comments

Vectorized MAXSCORE over WAND, especially for long LLM-generated queries

turbopuffer.com
4 points·by Sirupsen·vor 7 Monaten·0 comments

comments

Sirupsen
·vor 5 Monaten·discuss
Yep! Other than random reads (~p99=200ms on larger ranges), it's essential to get good download performance of a single file. A single (range) request can "only" drive ~500 MB/s, so you need multiple offsets.

https://github.com/sirupsen/napkin-math
Sirupsen
·vor 5 Monaten·discuss
Due to the batching, this will only consume a few million class B per month. They are $5/million
Sirupsen
·vor 5 Monaten·discuss
(cofounder of tpuf here)

We don't have a relational database, otherwise that would work great for a queue! You can imagine us continuing to iterate here to Step 5, Step 6, ... Step N over time. The tradeoff of each step is complexity, and complexity has to be deserved. This is working exceptionally well currently.
Sirupsen
·vor 8 Monaten·discuss
Our query planner has that built in! We've spent a lot of time making high recall with any selectivity in the fitler work.