HackerTrans
TopNewTrendsCommentsPastAskShowJobs

gatesn

no profile record

Submissions

Towards Vortex 1.0

spiraldb.com
7 points·by gatesn·w zeszłym roku·0 comments

ALP Rust is faster than C++

blog.spiraldb.com
16 points·by gatesn·w zeszłym roku·1 comments

London Systems Meetup

lu.ma
6 points·by gatesn·w zeszłym roku·1 comments

What if we just didn't decompress it?

blog.spiraldb.com
12 points·by gatesn·w zeszłym roku·2 comments

Zone maps, or "queries go brrr"

blog.spiraldb.com
7 points·by gatesn·w zeszłym roku·0 comments

Logical vs. Physical Data Types

blog.spiraldb.com
33 points·by gatesn·2 lata temu·0 comments

Show HN: Vortex – a high-performance columnar file format

github.com
249 points·by gatesn·2 lata temu·61 comments

Life in the FastLanes

blog.spiraldb.com
12 points·by gatesn·2 lata temu·0 comments

Taking Risk

tomblomfield.com
209 points·by gatesn·2 lata temu·293 comments

comments

gatesn
·w zeszłym roku·discuss
Hey HN, encouraged by the "reawakening of systems programming meetups" in SF, NY, and others, we (Spiral) have decided to spin up the London Systems Meetup to here stories and deep dives into all things systems/databases.

The inaugural event will feature talks from Mistral and ourselves, with plenty of time for mingling over drinks and pizza.
gatesn
·w zeszłym roku·discuss
How push-down compute helps Vortex run faster and decompress less
gatesn
·2 lata temu·discuss
Internally the design of Vortex is very similar. The file consists of a whole bunch of "messages" (your files), which then have some metadata attached, and the read logic decides which messages it needs when.
gatesn
·2 lata temu·discuss
I actually found that DataDog's ddtrace [1] and datadog [2] libraries are very good for instrumenting Python, even in the absence of any connection to DataDog (and no affiliation to them on my part).

ddtrace patches popular Python libraries to emit metrics which can be collected by any statsd-compatible endpoint. The trace spans may well be more specific to the Datadog API though.

[1] https://github.com/DataDog/dd-trace-py/

[2] https://datadogpy.readthedocs.io/en/latest/