With Reddit's upcoming API changes[0], I got nervous that I'd no longer be able to access the many posts and comments I've left there over the years.
Inspired by the Dogsheep projects[1], this CLI lets you immediately pull your most recent 1k comments & 1k posts (the max allowed by the paged API) into a nicely-structured SQLite database. It's perfect for loading into Datasette for nice viewing & full-text search of your content.
Taking it a step further, the project's killer feature is the ability to import data from GDPR archives. This allows you to store your full Reddit history (including deleted comments and posts on removed subreddits).
I hope you find this tool useful! I'll be around to answer questions and field comments (or feel free to open a GH issue).
Inspired by the Dogsheep projects[1], this CLI lets you immediately pull your most recent 1k comments & 1k posts (the max allowed by the paged API) into a nicely-structured SQLite database. It's perfect for loading into Datasette for nice viewing & full-text search of your content.
Taking it a step further, the project's killer feature is the ability to import data from GDPR archives. This allows you to store your full Reddit history (including deleted comments and posts on removed subreddits).
I hope you find this tool useful! I'll be around to answer questions and field comments (or feel free to open a GH issue).
[0]: https://old.reddit.com/r/reddit/comments/12qwagm/an_update_r...
[1]: https://dogsheep.github.io/