HackerTrans
TopNewTrendsCommentsPastAskShowJobs

linl

no profile record

Submissions

[untitled]

1 points·by linl·2 года назад·0 comments

Map_shared and RSS/SHR

jack.culhane.ie
1 points·by linl·2 года назад·1 comments

Building a high-frequency, liquidity-taking strategy in Python

databento.com
27 points·by linl·2 года назад·0 comments

Building high-frequency trading signals in Python with Databento and sklearn

databento.medium.com
5 points·by linl·3 года назад·0 comments

[untitled]

1 points·by linl·3 года назад·0 comments

comments

linl
·2 года назад·discuss
Thanks for sharing. I helped write this guide. My team and I collectively wrote connectivity for around 80-140 trading venues at major trading firms before this, and we tried to distill it down to the basics you need to know. Happy to answer any other questions!
linl
·2 года назад·discuss
Recently our team at Databento was debugging a memory leak on an experimental debugging branch. For context, this is on a Rust application that distributes billions of market data messages per day and we're using shared memory/mmap queues for interprocess communication. It turned out to be a false alarm due to adding tokio-console to a component.
linl
·3 года назад·discuss
There are several types of process models that's suitable for a DBMS: 1 process per DBMS worker, 1 thread per DBMS worker, a lightweight thread pool, a process pool, etc.

Hellerstein, Stonebraker and Hamilton (2007) is a great introduction on this.
linl
·3 года назад·discuss
I agree with this. B-trees vs hash indices, I/O hierarchy, process model, etc.

Also in the modern day, it's valuable to learn common strategies behind column-oriented databases such as late tuple materialization, deferred execution, linear scans vs. binary search, instruction pipelining.

Once you're familiar with all this, you'd find sometimes in the field what you really need is a simple flat file or an embeddable database like RocksDB, not a DBMS.