HackerTrans
TopNewTrendsCommentsPastAskShowJobs

KAdot

no profile record

Submissions

Timeseries Indexing at Scale

artem.krylysov.com
3 points·by KAdot·2 yıl önce·0 comments

Timeseries Indexing at Scale

datadoghq.com
4 points·by KAdot·2 yıl önce·0 comments

comments

KAdot
·2 ay önce·discuss
Going back to 4.7 with `claude --model claude-opus-4-7` fixed it for me.
KAdot
·3 ay önce·discuss
Is it closed source?
KAdot
·11 ay önce·discuss
This is not my experience. I've been running RocksDB for 4 years on thousands of machines, each storing terabytes of data, and I haven't seen a single correctness issue caused by RocksDB.
KAdot
·geçen yıl·discuss
> We are interested in making OTAP pipelines safely embeddable, through strict controls on memory and through support for thread-per-core runtimes.

I'm curious about the thread-per-core runtimes, are there even any mature thread-per-core runtimes in Rust around?
KAdot
·geçen yıl·discuss
The benchmark doesn't accurately represent the real-world database performance because the dataset is too small (roughly half a gigabyte based on [1]?), meaning it fits into the page cache bypassing disk I/O.

[1]: https://github.com/voidDB/voidDB/blob/master/test/bench_test...
KAdot
·2 yıl önce·discuss
The benchmark is not comparing apples to apples.

prost is the most widely used Protobuf implementation in Rust, maintained by the Tokio organization. prost generates structs and serialization/deserialization code for you.

easyproto according to GitHib Search is used only by two projects. easyproto provides primitives for serializing and deserializing Protobuf, and requires hand writing code to do both.

A fair comparison would be prost vs google.golang.org/protobuf, or easyproto vs parts of quick-protobuf.

In most cases you can make Go as fast as Rust, but from my experience writing performance-sensitive code in Go requires significantly larger time investment and overall requires deeper language expertise. Pebble (RocksDB replacement in Go by CockroachDB) is a good example of this, the codebase is littered with hand-inlined[1] functions, hand-unrolled loops and it's not[2] even using Go memory management for performance critical parts, it's using the C memory allocator and manual memory management.

[prost]: https://github.com/tokio-rs/prost [easyproto]: https://github.com/VictoriaMetrics/easyproto [google.golang.org/protobuf]: https://github.com/protocolbuffers/protobuf-go [quick-protobuf]: https://github.com/tafia/quick-protobuf [1]: https://github.com/cockroachdb/pebble/blob/c34894c46703fd823... [2]: https://github.com/cockroachdb/pebble/blob/master/docs/memor...
KAdot
·2 yıl önce·discuss
The redis.io landing page says "from the ones who built it" just wow.
KAdot
·2 yıl önce·discuss
https://github.com/pineappleEA/pineapple-src
KAdot
·2 yıl önce·discuss
The project is gone from GitHub already https://github.com/yuzu-emu/yuzu
KAdot
·2 yıl önce·discuss
> After discovering Chrome are eating my old Mac's battery, I turned to using Edge

What? Have they tried using Safari instead of a Chromium based browser? From my experience Safari is by far the best browser on Mac in terms of the energy efficiency.
KAdot
·2 yıl önce·discuss
Is there a way to disable all "collaborative" features, including removing the "Sign in" button?
KAdot
·3 yıl önce·discuss
A similar idea implemented in Go https://github.com/akrylysov/pogreb (disclaimer: I'm the author of this package).
KAdot
·3 yıl önce·discuss
The performance is not that great, but you can already play Cyberpunk 2077 on a M2 Pro laptop using Game Porting Toolkit https://www.youtube.com/watch?v=sPJpkRmsceU Keep in mind, it has to do x64 -> ARM64 transition and translate Direct X into Metal. I would expect a native version to work better.
KAdot
·3 yıl önce·discuss
https://artem.krylysov.com/blog/ I'm writing mostly about databases and performance.

My last two posts:

- How RocksDB works https://artem.krylysov.com/blog/2023/04/19/how-rocksdb-works...

- Let's build a Full-Text Search engine https://artem.krylysov.com/blog/2020/07/28/lets-build-a-full...
KAdot
·3 yıl önce·discuss
Great article. If someone is looking for a more advanced example, some time ago, as an exercise, I created an interpreter for a Python-like language in Python https://github.com/akrylysov/abrvalg