HackerTrans
TopNewTrendsCommentsPastAskShowJobs

miked98

no profile record

comments

miked98
·il y a 5 mois·discuss
Does it require a semantic layer such as DBT, Lightdash, or Rill?
miked98
·il y a 10 mois·discuss
In our experience, the primary driver of Snowflake costs is not the compute for aggregation, but the compute required for lots of reads/scans.

We recently built a Snowflake-to-ClickHouse pipeline for a customer where aggregates are built hourly in Snowflake, then pushed into a ClickHouse table to power their user-facing dashboards.

By offloading dashboard queries to ClickHouse, they slashed their Snowflake bill by ~25%, which was worth millions to them.

(Admittedly, running aggregations elsewhere—for example, in Spark—could further reduce costs, but you would then need Iceberg to make the tables queryable in Snowflake.)