HackerTrans
トップ新着トレンドコメント過去質問紹介求人

oatsandsugar

no profile record

投稿

Define once, use everywhere: a metrics layer for ClickHouse with MooseStack

clickhouse.com
1 ポイント·投稿者 oatsandsugar·4 か月前·0 コメント

Super interesting Wikipedia on HN. So I made wiki-hn.

wiki-hn.com
3 ポイント·投稿者 oatsandsugar·4 か月前·1 コメント

AI harness for PG –> CH migrations

clickhouse.com
2 ポイント·投稿者 oatsandsugar·5 か月前·0 コメント

Migrating from Postgres to ClickHouse for faster dashboards

docs.fiveonefour.com
3 ポイント·投稿者 oatsandsugar·5 か月前·0 コメント

Alphabet sells 100 year bonds

marginalrevolution.com
2 ポイント·投稿者 oatsandsugar·5 か月前·0 コメント

Light Fantastic: ISS videos of "light" set to the music of Chris Zabriskie

kottke.org
3 ポイント·投稿者 oatsandsugar·7 か月前·0 コメント

Analytical dashboards and AI chat: local dev to prod (Vercel and Boreal)

fiveonefour.com
1 ポイント·投稿者 oatsandsugar·7 か月前·0 コメント

Spurious Correlations: Eng degrees vs. searches for nearby "dollar stores"

tylervigen.com
2 ポイント·投稿者 oatsandsugar·7 か月前·0 コメント

Wenis

en.wikipedia.org
3 ポイント·投稿者 oatsandsugar·7 か月前·0 コメント

How good are social scientists at forecasting?

nber.org
4 ポイント·投稿者 oatsandsugar·8 か月前·1 コメント

OLAP migration complexity is the cost of fast reads

fiveonefour.com
1 ポイント·投稿者 oatsandsugar·8 か月前·0 コメント

How a Nix flake made our polyglot stack (and new dev onboarding) fast and sane

fiveonefour.com
4 ポイント·投稿者 oatsandsugar·8 か月前·1 コメント

Data Modeling for OLAP with AI Ft. District Cannabis (MooseStack, ClickHouse)

fiveonefour.com
1 ポイント·投稿者 oatsandsugar·8 か月前·0 コメント

From OLTP ORMs to OLAP Data Models (TypeORM, SQLModel, Drizzle, MooseStack)

github.com
1 ポイント·投稿者 oatsandsugar·9 か月前·2 コメント

Derive OLAP data models from SQLModel

fiveonefour.com
2 ポイント·投稿者 oatsandsugar·9 か月前·0 コメント

Derive an OLAP Data Model from Your OLTP ORM (Drizzle, Prisma, TypeORM)

fiveonefour.com
2 ポイント·投稿者 oatsandsugar·9 か月前·0 コメント

Code First CDC from Postgres to ClickHouse W Debezium, Redpanda, and MooseStack

fiveonefour.com
3 ポイント·投稿者 oatsandsugar·9 か月前·0 コメント

Space Exploration Logo Archive

spaceexplorationlogoarchive.webflow.io
2 ポイント·投稿者 oatsandsugar·9 か月前·1 コメント

ClickHouse table engines & CDC data (MergeTree, Replacing, Collapsing +)

fiveonefour.com
3 ポイント·投稿者 oatsandsugar·9 か月前·1 コメント

Optimizing writes to OLAP using buffers (ClickHouse, Redpanda, MooseStack)

fiveonefour.com
40 ポイント·投稿者 oatsandsugar·9 か月前·16 コメント

コメント

oatsandsugar
·先月·議論
This is surprisingly beautiful:

> The word foil comes from the old practice of backing gems with foil to make them shine more brightly.
oatsandsugar
·4 か月前·議論
How does this law allow for non-democracies?
oatsandsugar
·4 か月前·議論
Some favorites:

* https://en.wikipedia.org/wiki/User:Junnn11

* https://en.wikipedia.org/wiki/Timeline_of_the_far_future

* https://en.wikipedia.org/wiki/Ha-ha
oatsandsugar
·5 か月前·議論
Oh I've been loving this series: its like clickspring for automata.

The magnetic hands were such a cool idea, and the way he builds the springs for the bowden cables in ep 2, gorgeous!
oatsandsugar
·7 か月前·議論
Thesis is "crypto millionaires squeeze out other consumers from high demand goods, loss of crypto value reduces demand for those and thus benefits other consumers"
oatsandsugar
·8 か月前·議論
The "choose your date by selecting a substring of pi" is absolutely incredible.
oatsandsugar
·8 か月前·議論
[This paper] show[s] that forecasters, on average, over-estimate treatment effects; however, the average forecast is quite predictive of the actual treatment effect.
oatsandsugar
·8 か月前·議論
When I was in Venture, I did a tonne of research into the Nix ecosystem.

Fast forward to now, a new hire at the startup I work at, on his own volition, implemented a Nix flake day one at the company. Within the week, a bunch of our engineers were using it.

Super cool to see, mainly because of the decreased frustration in setting up our dev environments.
oatsandsugar
·9 か月前·議論
Thank you mate! fixing
oatsandsugar
·9 か月前·議論
Author here: commented here about how you can use async inserts if that's your preferred ingest method (we recommend that for batch).

https://news.ycombinator.com/item?id=45651098

One of the reasons we streaming ingests is because we often modify the schema of the data in stream. Usually to conform w ClickHouse best practices that aren't adhered to in the source data (restrictive types, denormalization, default not nullable, etc).
oatsandsugar
·9 か月前·議論
Author here—this article was meant to highlight how you can optimize writes to CH with streams.

If you want to directly insert data into ClickHouse with MooseStack, we have a direct insert method that allows you to use ClickHouse's bulkload methods.

Here's the implementation: https://github.com/514-labs/moosestack/blob/43a2576de2e22743...

Documentation is here: https://docs.fiveonefour.com/moose/olap/insert-data#performa...

Would love to hear your thoughts on our direct insert implementation!
oatsandsugar
·9 か月前·議論
Timely! We're redesigning our blog, will keep you posted
oatsandsugar
·9 か月前·議論
Co-author here, we used Debezium here because it supports many different databases. Unfortunately, no sqlite support—my understanding is as an embedded db it lacks some of the prerequisites that Debezium relies on.

Have you run CDC from sqlite? would love to hear how you did it and to try build a demo with MooseStack
oatsandsugar
·9 か月前·議論
I think my favorite part was the ability to use the same Drizzle TS data models created for Postgres for creating tables in ClickHouse
oatsandsugar
·9 か月前·議論
I mean the Azerbaijan one goes so hard:

https://spaceexplorationlogoarchive.webflow.io/loghi/azerbai...
oatsandsugar
·9 か月前·議論
Author here: I wrote out some worked examples about how ClickHouse's table engines affect how CDC updates and deletes are treated (on initial write, and on merge), coming to the conclusion that the ReplacingMergeTree is the goldilocks table engine for most CDC use-cases.
oatsandsugar
·9 か月前·議論
One of the works:

> In early work, El-Badry developed a method for identifying binary stars in spectrographic datasets. More than half of stars exist in binary systems, but they are often too close together to be differentiated with available technology. El-Badry overcame this challenge through targeted statistical analysis of existing spectral data.

Another

> Porras-Kim selected fragmented objects of unknown origins from the storage shelves of the Fowler Museum at UCLA, whose collections span the arts and cultures of Africa, Asia, the Pacific, and the Indigenous Americas. Her resulting installation, entitled Reconstructions, brought together the artifacts with drawings and sculptures that prompted viewers to consider how the textile fragments, pottery shards, and other orphaned objects functioned and came to be acquired by the museum.
oatsandsugar
·9 か月前·議論
I love that these grants go to such an incredible variety of impressive folk—from music to astrophysics.
oatsandsugar
·9 か月前·議論
That's really intuitive, especially your description of column notation. Excited to read your other guides!

Also, HT to your user name! Egon Schiele is one of my favorite artists! Loved seeing his works at the Neue in NYC.
oatsandsugar
·9 か月前·議論
Apple coding interview?