You may want to have a look at qri "query" - https://qri.io (disclosure, I work there).
Free & open-source tools for dataset versioning built on IPFS (the distributed web). Qri datasets contain commit histories, immutable hashes for each version (commit), schema info, metadata, readmes, & transform scripts, all of which ride together with the data (or, body).
Latest versions of our CLI tools support SQL & version diffing. We also have an electron app, Qri Desktop (https://qri.io/desktop)
Qri | Software Engineers | New York, NY or Remote | Part-time Contracting |
Qri (https://qri.io) is building free and open-source dataset versioning software. With Qri, you can copy, edit, & share public datasets, perform key tasks like data munging/cleaning, version tracking, and dataset auto-updating/synching, all while tracking changes and attributing them to authors (peers) in the network.
We are a team of 5 experienced devs and data nerds based in Brooklyn. We’d be happy to hire remote and find flexible work arrangements for the right person.
Tech we use:
- go programming language
- familiarity with IPFS, libp2p, WebRTC, Bittorrents a plus
- React
- Typescript, Storybook, Webpack, Electron
- Kubernetes
Hit us up at [email protected]. To check out details on the two roles we have open, visit us:
Qri | Software Engineers | New York, NY or Remote | Part-time Contracting |
Qri (https://qri.io) is building free and open-source dataset versioning software. With Qri, you can copy, edit, & share public datasets, perform key tasks like data munging/cleaning, version tracking, and dataset auto-updating/synching, all while tracking changes and attributing them to authors (peers) in the network.
We are a team of 5 experienced devs and data nerds based in Brooklyn. We’d be happy to hire remote and find flexible work arrangements for the right person.
Tech we use:
- go programming language
- familiarity with IPFS, libp2p, WebRTC, Bittorrents a plus
- React
- Typescript, Storybook, Webpack, Electron
- Kubernetes
Hit us up at [email protected]. To check out details on the two roles we have open, visit us:
Qri | Software Engineers | New York, NY or Remote | Part-time Contracting |
Qri (https://qri.io) is building free and open-source dataset versioning software. With Qri, you can copy, edit, & share public datasets, perform key tasks like data munging/cleaning, version tracking, and dataset auto-updating/synching, all while tracking changes and attributing them to authors (peers) in the network.
We are a team of 5 experienced devs and data nerds based in Brooklyn. We’d be happy to hire remote and find flexible work arrangements for the right person.
Tech we use:
* go programming language
* familiarity with IPFS, libp2p, WebRTC, Bittorrents a plus
* React
* Typescript, Storybook, Webpack, Electron
* Kubernetes
Hit us up at [email protected]. To check out details on the two roles we have open, visit us:
I'm promoting the latest release of Qri -pronounced ‘query’- (0.6.1), a free and open source dataset version control system / network for finding, collaborating on and publishing open datasets on IPFS. It's a kind of git/github just for open datasets.
We (qri) have built a front-end webapp (free & open source) for publishing, sharing, and versioning datasets on IPFS. When you download qri, you're working on IPFS (distributed web).
We (qri) have built a front-end webapp (free & open source) for publishing, sharing, and versioning datasets on IPFS. When you download qri, you're working on IPFS (distributed web).
Still very geeky, but we're trying to make sure it's very simple to use for data scientists/analysts/researchers alike.
This is a super valuable perspective! We (https://qri.io) are building a kind of git/github for datasets and are hoping to talk to would-be users about just this issue. Would love to have your feedback on it (particularly on how commits are registered). Mind if I ping you at the email address you listed? - Rico
We're building something just like that at qri (https://qri.io) a free and open source dataset version control system. Right now all datasets on qri are public by default, but we're working toward supporting. encryption and private networks.
Totally agree! At Qri (https://qri.io) we're working on many of these problems together - hosting, formatting (interoperability), provenance and sync. It's an open source project - we'd love to have your feedback as we design it!
Free & open-source tools for dataset versioning built on IPFS (the distributed web). Qri datasets contain commit histories, immutable hashes for each version (commit), schema info, metadata, readmes, & transform scripts, all of which ride together with the data (or, body).
Latest versions of our CLI tools support SQL & version diffing. We also have an electron app, Qri Desktop (https://qri.io/desktop)