HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jimsparkman

no profile record

Submissions

Western States 100 Mile Endurance Run: How it all began

wser.org
1 points·by jimsparkman·2 ปีที่แล้ว·0 comments

comments

jimsparkman
·3 ปีที่แล้ว·discuss
I think this is the exception, not the norm. My experience is business users (incl. PMs) are lost outside of Excel.
jimsparkman
·3 ปีที่แล้ว·discuss
I don’t know anything about the game, but I’m guessing the new account was created to protect his identity, should the ploy fail?
jimsparkman
·3 ปีที่แล้ว·discuss
That program sounds quite impressive, I wonder if any equivalencies exist in the US?
jimsparkman
·4 ปีที่แล้ว·discuss
The slides [1] helped me grok what problems this tool solves pretty quickly.

Everything big data is moving to blob storage these days, but streaming can lead to small files problem or longer latencies. File fragments stored locally with proxied readers seems like a simple solution to that.

[1] https://gazette.readthedocs.io/en/latest/overview-slides.htm...
jimsparkman
·4 ปีที่แล้ว·discuss
I assume they are using something like DB2, which has very specific meaning when it comes to temporal or bitemporal tables.

https://www.ibm.com/docs/en/db2/10.5?topic=tables-bitemporal
jimsparkman
·4 ปีที่แล้ว·discuss
Since duckdb is OLAP, it would directly compare with other columnar database technologies like Redshift, Presto/Athena, etc.

Most of these systems strongly encourage or outright enforce JSONL, so that’s the defacto standard, and most tooling or pipelines are going to generate that nowadays.

You can obviously still have a row of arrays, and different systems have slightly different approaches on how to deal with those. In Spark, this is referred to as “exploding”, in Presto you would cross join to unnest an array, in Redshift you can glob on the super type.

I’m not sure I have a particular favorite, only that the database support such an operation since it is a common occurrence.