I think what many people are finding out is they don’t really need distributed processing. DuckDB on a single node can get you really far, and it’s much simpler.
On a computer, just uBlock Origin and it works wonders.
Tangential question - what is the best solution for iPhone? On Androids you can use Firefox with uBlock, but it seems none of the Safari extensions on iPhone actually work, I tried some paid ones too. Brave seems to work decently well, but I have no idea why - if other browsers have some OS limitation, how does Brave go around it?
A huge downside of writing this down on paper is team collaboration. Imagine that instead this is kept in a tool like Notion which the entire team can access. At first this feels incredibly uncomfortable - your notes are there for everyone to see. However it’s a massive force multiplier because often the work is picked up by someone else later on, and instead of asking you they can self-serve. It’s pretty common that by the time they need it you would no longer be at the company.
I don’t have experience writing in a lab journal format, but for documents like growth experiments and how they worked, or RFCs, this is a godsend. It takes a lot of work to keep it tidy, but it’s worth it.
There's an important thing that is easy to miss if you just use a Google Takeout for the export – your Shared albums will only contain pictures that you yourself added!
I went through this journey a few months ago, and it's pretty hard to catch because those albums will appear in the export, and they are not empty, so you don't expect that they are partial exports. The way to export them was going one by one in the regular Google Photos app, and downloading each album as a ZIP – that way you get pictures also from other contributors to that album.
Funnily enough, I also experienced some rate limiting and had to wait a few minutes after every 6-7 albums.
My end goal was importing the Takeout into Apple Photos library locally stored on my Mac. Some other steps I had to take were:
- Fixing the metadata [0] so they showed up with a correct date
- Importing albums first, and the "Stream" (a folder per year) second, because otherwise the deduplication would mean the pictures already in the stream wouldn't get added to an album.