HackerTrans
TopNewTrendsCommentsPastAskShowJobs

KAdot

no profile record

Submissions

Timeseries Indexing at Scale

artem.krylysov.com
3 points·by KAdot·vor 2 Jahren·0 comments

Timeseries Indexing at Scale

datadoghq.com
4 points·by KAdot·vor 2 Jahren·0 comments

comments

KAdot
·vor 2 Monaten·discuss
Going back to 4.7 with `claude --model claude-opus-4-7` fixed it for me.
KAdot
·vor 3 Monaten·discuss
Is it closed source?
KAdot
·vor 11 Monaten·discuss
This is not my experience. I've been running RocksDB for 4 years on thousands of machines, each storing terabytes of data, and I haven't seen a single correctness issue caused by RocksDB.
KAdot
·letztes Jahr·discuss
> We are interested in making OTAP pipelines safely embeddable, through strict controls on memory and through support for thread-per-core runtimes.

I'm curious about the thread-per-core runtimes, are there even any mature thread-per-core runtimes in Rust around?
KAdot
·letztes Jahr·discuss
The benchmark doesn't accurately represent the real-world database performance because the dataset is too small (roughly half a gigabyte based on [1]?), meaning it fits into the page cache bypassing disk I/O.

[1]: https://github.com/voidDB/voidDB/blob/master/test/bench_test...
KAdot
·vor 2 Jahren·discuss
The benchmark is not comparing apples to apples.

prost is the most widely used Protobuf implementation in Rust, maintained by the Tokio organization. prost generates structs and serialization/deserialization code for you.

easyproto according to GitHib Search is used only by two projects. easyproto provides primitives for serializing and deserializing Protobuf, and requires hand writing code to do both.

A fair comparison would be prost vs google.golang.org/protobuf, or easyproto vs parts of quick-protobuf.

In most cases you can make Go as fast as Rust, but from my experience writing performance-sensitive code in Go requires significantly larger time investment and overall requires deeper language expertise. Pebble (RocksDB replacement in Go by CockroachDB) is a good example of this, the codebase is littered with hand-inlined[1] functions, hand-unrolled loops and it's not[2] even using Go memory management for performance critical parts, it's using the C memory allocator and manual memory management.

[prost]: https://github.com/tokio-rs/prost [easyproto]: https://github.com/VictoriaMetrics/easyproto [google.golang.org/protobuf]: https://github.com/protocolbuffers/protobuf-go [quick-protobuf]: https://github.com/tafia/quick-protobuf [1]: https://github.com/cockroachdb/pebble/blob/c34894c46703fd823... [2]: https://github.com/cockroachdb/pebble/blob/master/docs/memor...
KAdot
·vor 2 Jahren·discuss
The redis.io landing page says "from the ones who built it" just wow.
KAdot
·vor 2 Jahren·discuss
https://github.com/pineappleEA/pineapple-src
KAdot
·vor 2 Jahren·discuss
The project is gone from GitHub already https://github.com/yuzu-emu/yuzu