HackerTrans
トップ新着トレンドコメント過去質問紹介求人

Sirupsen

no profile record

投稿

Rust zero-cost abstractions vs. SIMD

turbopuffer.com
24 ポイント·投稿者 Sirupsen·4 か月前·4 コメント

SpacetimeDB: A Short Technical Review

strn.cat
9 ポイント·投稿者 Sirupsen·4 か月前·0 コメント

A distributed queue in a single JSON file on object storage

turbopuffer.com
171 ポイント·投稿者 Sirupsen·5 か月前·55 コメント

Vectorized MAXSCORE over WAND, especially for long LLM-generated queries

turbopuffer.com
4 ポイント·投稿者 Sirupsen·7 か月前·0 コメント

コメント

Sirupsen
·5 か月前·議論
Yep! Other than random reads (~p99=200ms on larger ranges), it's essential to get good download performance of a single file. A single (range) request can "only" drive ~500 MB/s, so you need multiple offsets.

https://github.com/sirupsen/napkin-math
Sirupsen
·5 か月前·議論
Due to the batching, this will only consume a few million class B per month. They are $5/million
Sirupsen
·5 か月前·議論
(cofounder of tpuf here)

We don't have a relational database, otherwise that would work great for a queue! You can imagine us continuing to iterate here to Step 5, Step 6, ... Step N over time. The tradeoff of each step is complexity, and complexity has to be deserved. This is working exceptionally well currently.
Sirupsen
·8 か月前·議論
Our query planner has that built in! We've spent a lot of time making high recall with any selectivity in the fitler work.