HackerTrans
TopNewTrendsCommentsPastAskShowJobs

vivek-jain

no profile record

Submissions

Open sourcing Dicer: Databricks's auto-sharder

databricks.com
85 points·by vivek-jain·قبل 6 أشهر·11 comments

comments

vivek-jain
·قبل 6 أشهر·discuss
Sharded in-memory caching turns out to be rather useful at scale :)

Some of the key examples highlighted on our blog are Unity Catalog, which is essentially the metadata layer for Databricks, our Query Orchestration Engine, and our distributed remote cache. See the blog post for more!
vivek-jain
·قبل 6 أشهر·discuss
[dead]