HackerTrans
TopNewTrendsCommentsPastAskShowJobs

bach4ants

no profile record

Submissions

Continuous Reproducibility: How DevOps could improve scientific research

petebachant.me
1 points·by bach4ants·tahun lalu·0 comments

comments

bach4ants
·12 bulan yang lalu·discuss
Are you saying that governments should try to reduce the number of humans?
bach4ants
·tahun lalu·discuss
And further, with this pg_mooncake extension allowing you to store the data in S3, is Postgres simply providing compute to run DuckDB? I suppose it's also providing a standardized interface and "data catalog."
bach4ants
·2 tahun yang lalu·discuss
Yep. I personally like DVC's pipeline implementation because it's lightweight and language-agnostic, but haven't gotten into using their experiment tracking features.
bach4ants
·2 tahun yang lalu·discuss
I have noticed this as well. There is a huge resistance to learning Git, and I think it's partly warranted. Researchers know what it is, and know that it's valuable, but think it will take too long to learn and they want to move fast. I recently started building a tool called Calkit (https://github.com/calkit/calkit) in an attempt to simply and unify Git and DVC for these types of researchers. Hoping to convince folks that working reproducibly is actually faster in the long run, never mind the fact that it makes their work more directly usable for pushing the field forward more quickly overall.