HackerTrans
TopNewTrendsCommentsPastAskShowJobs

bach4ants

no profile record

Submissions

Continuous Reproducibility: How DevOps could improve scientific research

petebachant.me
1 points·by bach4ants·el año pasado·0 comments

comments

bach4ants
·hace 12 meses·discuss
Are you saying that governments should try to reduce the number of humans?
bach4ants
·el año pasado·discuss
And further, with this pg_mooncake extension allowing you to store the data in S3, is Postgres simply providing compute to run DuckDB? I suppose it's also providing a standardized interface and "data catalog."
bach4ants
·hace 2 años·discuss
Yep. I personally like DVC's pipeline implementation because it's lightweight and language-agnostic, but haven't gotten into using their experiment tracking features.
bach4ants
·hace 2 años·discuss
I have noticed this as well. There is a huge resistance to learning Git, and I think it's partly warranted. Researchers know what it is, and know that it's valuable, but think it will take too long to learn and they want to move fast. I recently started building a tool called Calkit (https://github.com/calkit/calkit) in an attempt to simply and unify Git and DVC for these types of researchers. Hoping to convince folks that working reproducibly is actually faster in the long run, never mind the fact that it makes their work more directly usable for pushing the field forward more quickly overall.