HackerTrans
TopNewTrendsCommentsPastAskShowJobs

vivek-jain

no profile record

Submissions

Open sourcing Dicer: Databricks's auto-sharder

databricks.com
85 points·by vivek-jain·6 bulan yang lalu·11 comments

comments

vivek-jain
·6 bulan yang lalu·discuss
Sharded in-memory caching turns out to be rather useful at scale :)

Some of the key examples highlighted on our blog are Unity Catalog, which is essentially the metadata layer for Databricks, our Query Orchestration Engine, and our distributed remote cache. See the blog post for more!
vivek-jain
·6 bulan yang lalu·discuss
[dead]