HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Sirupsen

no profile record

Submissions

Rust zero-cost abstractions vs. SIMD

turbopuffer.com
24 points·by Sirupsen·4 miesiące temu·4 comments

SpacetimeDB: A Short Technical Review

strn.cat
9 points·by Sirupsen·4 miesiące temu·0 comments

A distributed queue in a single JSON file on object storage

turbopuffer.com
171 points·by Sirupsen·5 miesięcy temu·55 comments

Vectorized MAXSCORE over WAND, especially for long LLM-generated queries

turbopuffer.com
4 points·by Sirupsen·7 miesięcy temu·0 comments

comments

Sirupsen
·5 miesięcy temu·discuss
Yep! Other than random reads (~p99=200ms on larger ranges), it's essential to get good download performance of a single file. A single (range) request can "only" drive ~500 MB/s, so you need multiple offsets.

https://github.com/sirupsen/napkin-math
Sirupsen
·5 miesięcy temu·discuss
Due to the batching, this will only consume a few million class B per month. They are $5/million
Sirupsen
·5 miesięcy temu·discuss
(cofounder of tpuf here)

We don't have a relational database, otherwise that would work great for a queue! You can imagine us continuing to iterate here to Step 5, Step 6, ... Step N over time. The tradeoff of each step is complexity, and complexity has to be deserved. This is working exceptionally well currently.
Sirupsen
·8 miesięcy temu·discuss
Our query planner has that built in! We've spent a lot of time making high recall with any selectivity in the fitler work.