HackerTrans
TopNewTrendsCommentsPastAskShowJobs

pierrebarre

106 karmajoined 4 jaar geleden

comments

pierrebarre
·2 uur geleden·discuss
[dead]
pierrebarre
·2 uur geleden·discuss
Hardlinks work as you’d expect: multiple paths point to the same inode and data, so a write through one path is visible through the others. Two separate files with the same contents are stored separately.

There’s no deduplication, either whole-file or block-level. That’s intentional, mostly because of the impact it would have on locality.

If by CoW you mean reflinks, those aren’t currently planned either. They avoid the content matching part of deduplication, but still require sharing extents between files and come with similar locality and complexity tradeoffs. Internally ZeroFS is copy-on-write, with immutable segments and checkpoints, but that isn’t exposed as reflinks.
pierrebarre
·10 uur geleden·discuss
Thanks!

stat doesn’t pull the file contents from S3; it only accesses the metadata tree, which is usually cached.

I haven’t benchmarked Borg or Restic specifically. Sequential writes can comfortably reach several Gbit/s. For follow-up runs, if they only stat unchanged files, that should stay entirely in metadata.

The default Redis/Valkey configuration should work fine for conditional_put. NFSv4 is unlikely for now. It would add a lot of surface area, and I’m pretty happy with where the 9P extensions are today.
pierrebarre
·11 uur geleden·discuss
That’s a fair concern. The closest thing right now is a deterministic simulation suite that injects storage faults and crashes at arbitrary points, then checks the recovered data against reference models. It runs hourly with fresh seeds.

CI also runs pjdfstest, xfstests, stress-ng, ZFS scrubs, and Jepsen crash/failover tests: https://github.com/Barre/ZeroFS#testing

ZeroFS is still pretty young as storage projects go, so I completely understand wanting to see it prove itself over time.
pierrebarre
·11 uur geleden·discuss
Author here. Thanks for posting this!

It’s been quite a ride building ZeroFS, and I’m happy to answer any questions.