HackerTrans
TopNewTrendsCommentsPastAskShowJobs

bach4ants

no profile record

Submissions

Continuous Reproducibility: How DevOps could improve scientific research

petebachant.me
1 points·by bach4ants·năm ngoái·0 comments

comments

bach4ants
·12 tháng trước·discuss
Are you saying that governments should try to reduce the number of humans?
bach4ants
·năm ngoái·discuss
And further, with this pg_mooncake extension allowing you to store the data in S3, is Postgres simply providing compute to run DuckDB? I suppose it's also providing a standardized interface and "data catalog."
bach4ants
·2 năm trước·discuss
Yep. I personally like DVC's pipeline implementation because it's lightweight and language-agnostic, but haven't gotten into using their experiment tracking features.
bach4ants
·2 năm trước·discuss
I have noticed this as well. There is a huge resistance to learning Git, and I think it's partly warranted. Researchers know what it is, and know that it's valuable, but think it will take too long to learn and they want to move fast. I recently started building a tool called Calkit (https://github.com/calkit/calkit) in an attempt to simply and unify Git and DVC for these types of researchers. Hoping to convince folks that working reproducibly is actually faster in the long run, never mind the fact that it makes their work more directly usable for pushing the field forward more quickly overall.