As we can see by the fact the above URL is currently not working, there's a high risk associated with the centralized nature of sci-hub. It's already been the target of a major court case in the US and the only reason it's still running is because the site and it's founder (Alexandra Elbakyan) are outside of the court's jurisdiction. But there's still a chance it could disappear one day, and what sort of impact would that have on the productivity of researchers, many of which will be unable to access the articles they need?
The library genesis project maintains the full collection of all articles archived by sci-hub. At http://gen.lib.rus.ec/scimag/ there are links in the download menu for both the torrents and database dumps.
For the full thing, you're going to need just over 70TB. The database dumps are updated weekly are are about 10GB each, compressed. As of today there are 81,000,000 articles in the collection. However, the collection is split up into many different torrents (100,000 articles each) so you can just grab a subset and seed those.
If sci-hub ever disappears, a highly-replicated backup will ensure that access to the articles is not lost, and a new frontend can be set up fairly easily. This won't help for new articles or those that haven't been archived, but it will preserve those that have.
As for the case against paywalled journals and the for-profit publishing industry, I can't make a better argument than that put forward by the editors of the Journal of Informetrics, who collectively resigned from Elsevier and published the first issue of their new open access journal just this week: https://www.mitpressjournals.org/doi/pdfplus/10.1162/qss_e_0...
As for the case for liberating paywalled articles: Aaron Swartz gave his life for this fight. It's now up to us to continue it.
Seconding the library genesis recommendation. There's a lot of people now mirroring those files, and uploading there will make those books easier to find for a wider audience than just the eye.
For those who support sci-hub's mission and would like to help ensure it can never be taken away, you may be interested in the following project to lay the groundwork necessary for a widely-replicated, decentralized version of the repository:
All of the documents accessed through sci-hub are archived by the library genesis project and made available as torrents. Currently there are just over 80 million articles included in these torrents. The total size of the archive is around 70TB. The link above also refers to the library genesis books collection, which is 33TB.
This effort has seen tremendous interest in recent weeks; the books collection (libgen) is now widely replicated, but around a third of the scimag articles collection (i.e. those from sci-hub) has only 1-2 reliable seeders and needs more before it can be considered safely backed up. If you have the resources available, I would encourage you to consider assisting. Previous discussion of this project is at https://news.ycombinator.com/item?id=21692222
Looking forward, the next step is to find a suitable way of providing accessible, truly decentralized access, without relying on a single point of failure (i.e. a web interface). Some have been exploring IPFS as a potential mechanism, but there are many ways this could be done. This is a challenging but important problem to solve; with the data available, there is now an opportunity for developers to address the access issues. There may come a day when the sci-hub website goes offline, and it would be good if a fallback is already in place at that point.
Aaron Swartz may no longer be with us, but his spirit lives on. It's now up to us to carry on the fight for which he paid so dearly.
80,700,000 articles as of today. These torrents contain every single article that's ever been accessed through sci-hub. Database dumps at http://gen.lib.rus.ec/dbdumps/ provide an index.
If you have the disk space and bandwidth, I would strongly encourage you to participate in this torrent seeding effort: https://www.reddit.com/r/DataHoarder/comments/ed9byj/library...
The library genesis project maintains the full collection of all articles archived by sci-hub. At http://gen.lib.rus.ec/scimag/ there are links in the download menu for both the torrents and database dumps.
For the full thing, you're going to need just over 70TB. The database dumps are updated weekly are are about 10GB each, compressed. As of today there are 81,000,000 articles in the collection. However, the collection is split up into many different torrents (100,000 articles each) so you can just grab a subset and seed those.
If sci-hub ever disappears, a highly-replicated backup will ensure that access to the articles is not lost, and a new frontend can be set up fairly easily. This won't help for new articles or those that haven't been archived, but it will preserve those that have.
As for the case against paywalled journals and the for-profit publishing industry, I can't make a better argument than that put forward by the editors of the Journal of Informetrics, who collectively resigned from Elsevier and published the first issue of their new open access journal just this week: https://www.mitpressjournals.org/doi/pdfplus/10.1162/qss_e_0...
As for the case for liberating paywalled articles: Aaron Swartz gave his life for this fight. It's now up to us to continue it.