HackerTrans
TopNewTrendsCommentsPastAskShowJobs

caffeinated_me

no profile record

comments

caffeinated_me
·14 hari yang lalu·discuss
Yeah, I'm probably misremembering some details there. Thanks
caffeinated_me
·14 hari yang lalu·discuss
Do you have any benchmarks with a mix of long open transactions and short ones? I've struggled a lot with WAL-E in the past there, and am curious if that changes here.
caffeinated_me
·5 bulan yang lalu·discuss
Looks like that still has downtime for a Postgres migration- you're suggesting going into maintenance mode and just doing a dump/restore. I've seen that take hours once you hit the terabyte scale, depending on hardware.

I've had pretty good luck setting up logical replication from Heroku to the new provider and having a 10-15 minute maintenance window to catch up once it's in sync. Might be worth considering.

You might also want to add a warning about Postgres versions. There's some old bugs around primary key hash functions that can cause corruption on a migration. I've seen it twice when migrating from Heroku to other vendors.
caffeinated_me
·6 bulan yang lalu·discuss
Thanks! Out of curiosity, does the NVME have a big effect on replication throughput? I've been wondering how much trouble I've had with other solutions is due to parsing WAL and how much is just slow cloud disk
caffeinated_me
·6 bulan yang lalu·discuss
It sounds like you're doing something similar to how Databricks works now that they've acquired neon, or Snowflake now that they got Crunchy. I'm guessing the local SSD is a big advantage, but what else is different with your approach?