garage was working fine in other scenarios but it really had pathological behavior with the small read/write with torrenting benchmarks. (see my previous link for detailed benchmarking)
The reason for me for trying this setup was to provide native S3 features for apps that support it, while still supporting POSIX semantics for other apps (we have a few), while replacing native RAID with a multi-server storage backend to extend available space, and potentially removing the need for backups for most of the non-critical data once it's replicated across different sites.
I never got NFS/SMB to saturate a Gbit/s LAN link, and other solutions like cephfs/glusterfs seemed more complex and did not necessarily have all the features (inotify/fsync).
I never tried rustfs but was particularly interested in garage for the "philosophy" of development: developed by academics with proper R&D, fully FLOSS, with low-end hardware and unstable links/sites in mind, aiming for technological degrowth. From the looks at the rustfs website, it looks like the opposite of that.
You are right i was trying to overengineer things. For now i still run RAID0 (+ backups for important data).
Thanks for the extra info, i will definitely come back to you when i have some results. It won't probably be until the end of the summer though, before i find the chance to put back online a test server.
Sure, a lot of countermeasures is possible. I will definitely consider it next time, but for this calendar which had sitted unused for years on this instance, i decided to just turn off the plugin. A random wordpress plugin is never only a DoS avenue but also a bunch of potential vulns.
I've been curious about ZeroFS. My usecase is running a real POSIX filesystem on top of garage for integration with non-S3 services. I've had very bad (short) experiment with JuiceFS (1). Is it worth benchmarking `zerofs mount` with garage?
My usecase is NAS storage of many small files + some big files (think big shared SMB for a non-profit). I need:
- fsync durability (as promised on zerofs homepage), including sqlite durability (so NFS is out of the question)
- inotify support for external script integration (did not find an issue/docs about this)
- support for reading/writing small blocks without hammering the CPU/disks (benchmarked with JuiceFS using torrents and was catastrophic)
Do you think ZeroFS currently makes a good candidate? If not, is the described usecase part of the ZeroFS roadmap?
Noone complained we can't discriminate DC IPs, though to be fair some (imo bad) operators did just that. This is not even about preventing bots, which has perfectly legitimate usecases (eg. Internet Archive).
This is about filtering out bad bots/actors who have no respect for your resources and will drain all of it causing bad experience for everyone. But because they know they don't respect robots.txt or even simple rate-limiting, they have to employ so-called residential VPNs. They're residential in that they route through real user connections, and so you can't block the IP/subnet without dropping a certain amount of legitimate human-driven traffic.
Personal example: some time ago, i had to disable a wordpress plugin on a site that was causing 100% CPU usage on the whole box (hosting dozens of wordpress instances). That plugin was a simple calendar, but a bot was repeatedly scraping non-existent (or rather, "no event planned for this day") pages for every date in the calendar that you can represent in the DB timestamp, clearing the cache as it went to try and find new events for 1000 years ago. Whoever operates this IP space doesn't matter to me, i'd just like to block them because they don't respect robot.txt… but i can't because they use a "residential proxy" and will change IP address every hour or so.
I'm interested in what you mean, if you could develop. Would it kill tokenmaxxing because it's so bad? Because it's incredibly efficient? Because it's way too expensive?
That's true, but they also probably didn't think individual residence would become a norm (despite all the problems it generates), and probably didn't think secondary housing would become a normal for middle classes (vacations were a high bourgeoisie thing entirely until fairly recently).
Yes, but we usually use cars as a means to an end. Have you ever met a manager who setup gasmaxxing policies and criticized employees for doing their job instead of driving?
We used to have something similar in France: solidarity tax on fortune (ISF), abolished by Macron at the height of the gilets jaunes movement in a big "fuck you" move.
Now it's much easier for wealthy elites to not pay taxes at all, as outlined in the past year with the Zucman tax debates (which elites opposed for daring to propose a 2% floor tax rate for those who don't pay 2%), and lately with the ministry of Finance Amélie de Montchalin lying to the members of parliament about the existence of a note produced by her own ministry showing that over 13000 millionaires pay effectively 0% income tax.
I'm not advocating for going back to the stone age. But if work was sufficiently shared, we could all work less. A lot of "work" is actually useless in terms of production and social use (see Graeber, Bullshit Jobs).
Linear progression is unfair, just like for taxation. If you're going to make a law like this, it should be something like nlog(n) so that the big players that abuse the system pay more than the little guy.
Quitting is an individual action with potential adverse consequences (misery).
The political question is why despite productivity in economic terms (which i know is flawed) growing many times over, do we still have to work as much, get paid so little, and have so many unemployed people looking for a job?
Looks like without a parasitic capitalist class, we could share resources and work and have people live better lives and work less.
Many economists, already from the 19th century, claimed that technological progress would reduce the workweek. Some imagined we'd work 3 days per week, others only 1. Some imagined we'd work a few hours everyday.
I remember many people even on this very site claiming AI would help humanity. I think the most ridiculous the most ridiculous claim was helping fight climate change, but helping produce more leisure time by automating work was definitely what some people thought, or at least what they wanted us to think while pushing their crap.
Well i mean there is an obvious solution to homelessness: requisition the empty dwellings. That's not exactly a business plan for maintenance in the long term, but that's certainly much better than the current situation.
You don't want ambiguity in a proper engineering project. In a simple webpage denouncing the slop machine and their prevalent sloperators, I've got more than enough to know i appreciate the initiative. I'm personally considering an actual boycott of anything remotely involving AI.
The answer is "simple": invest your energy in a workers union. Respect working law, and don't let the boss/manager overstep boundaries. Depending on your jurisdiction, this may mean that you can refuse extra hours, that you have no obligation to answer calls/emails outside of working hours, etc.
You should document everything the bosses are doing, because in many countries firing people for not magically becoming more productive is highly illegal. And workplace harassment is highly illegal.
Build up your power with your colleagues, stay strong and solidarity will prevail!
Disclaimer: i think you'd consider me into degrowth
> at least tripling the EU’s data centre capacity within the next 5–7 years
Who would that benefit? We already have too many of them treating too much data. Mom and pop shops don't need more data centers. Consumers don't need more data centers. Citizens don't need more data centers.
You probably know very well that any new data center will be used exclusively for surveillance technology and so called "artificial intelligence", which in my opinion are net negatives for society.
The reason for me for trying this setup was to provide native S3 features for apps that support it, while still supporting POSIX semantics for other apps (we have a few), while replacing native RAID with a multi-server storage backend to extend available space, and potentially removing the need for backups for most of the non-critical data once it's replicated across different sites.
I never got NFS/SMB to saturate a Gbit/s LAN link, and other solutions like cephfs/glusterfs seemed more complex and did not necessarily have all the features (inotify/fsync).
I never tried rustfs but was particularly interested in garage for the "philosophy" of development: developed by academics with proper R&D, fully FLOSS, with low-end hardware and unstable links/sites in mind, aiming for technological degrowth. From the looks at the rustfs website, it looks like the opposite of that.
You are right i was trying to overengineer things. For now i still run RAID0 (+ backups for important data).