HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Sirupsen

no profile record

Submissions

Rust zero-cost abstractions vs. SIMD

turbopuffer.com
24 points·by Sirupsen·4 เดือนที่ผ่านมา·4 comments

SpacetimeDB: A Short Technical Review

strn.cat
9 points·by Sirupsen·4 เดือนที่ผ่านมา·0 comments

A distributed queue in a single JSON file on object storage

turbopuffer.com
171 points·by Sirupsen·5 เดือนที่ผ่านมา·55 comments

Vectorized MAXSCORE over WAND, especially for long LLM-generated queries

turbopuffer.com
4 points·by Sirupsen·7 เดือนที่ผ่านมา·0 comments

comments

Sirupsen
·5 เดือนที่ผ่านมา·discuss
Yep! Other than random reads (~p99=200ms on larger ranges), it's essential to get good download performance of a single file. A single (range) request can "only" drive ~500 MB/s, so you need multiple offsets.

https://github.com/sirupsen/napkin-math
Sirupsen
·5 เดือนที่ผ่านมา·discuss
Due to the batching, this will only consume a few million class B per month. They are $5/million
Sirupsen
·5 เดือนที่ผ่านมา·discuss
(cofounder of tpuf here)

We don't have a relational database, otherwise that would work great for a queue! You can imagine us continuing to iterate here to Step 5, Step 6, ... Step N over time. The tradeoff of each step is complexity, and complexity has to be deserved. This is working exceptionally well currently.
Sirupsen
·8 เดือนที่ผ่านมา·discuss
Our query planner has that built in! We've spent a lot of time making high recall with any selectivity in the fitler work.