HackerTrans
TopNewTrendsCommentsPastAskShowJobs

adastral

no profile record

Submissions

Pg_hardstorage: PostgreSQL Backup, Done Right

github.com
5 points·by adastral·21 день назад·0 comments

RawTree

rawtree.com
3 points·by adastral·в прошлом месяце·0 comments

We moved our growth analytics back into Tinybird

tinybird.co
3 points·by adastral·в прошлом месяце·0 comments

Key Joins (SQL Proposal)

keyjoin.org
2 points·by adastral·2 месяца назад·0 comments

Git-worktree – Manage multiple working trees

git-scm.com
8 points·by adastral·11 месяцев назад·0 comments

Benchmarking Is Hard, Sometimes

vondra.me
2 points·by adastral·в прошлом году·0 comments

Decomposing Transactional Systems

transactional.blog
18 points·by adastral·в прошлом году·0 comments

Dynamically estimating and scaling Postgres' working set size (2024)

neon.tech
2 points·by adastral·в прошлом году·0 comments

AWS CloudWatch and AWS OpenSearch launch an integrated analytics experience

aws.amazon.com
2 points·by adastral·2 года назад·0 comments

comments

adastral
·10 месяцев назад·discuss
PostgresTV livestreams "vibe coding" 1h sessions implementing small PostgreSQL features with Cursor (mostly claude-4-sonnet model) every week, by experienced PostgreSQL contributors. [0] is their latest stream.

I personally have not watched much, but it sounds just like what you are looking for!

[0] https://www.youtube.com/watch?v=3MleDtXZUlM
adastral
·2 года назад·discuss
> I default to a headless browser

Headless browsers consume orders of magnitude more resources, and execute far more requests (e.g. fetching images) than a common webscraping job would require. Having run webscraping at scale myself, the cost of operating headless browsers made us only use them as a last resort.
adastral
·2 года назад·discuss
From https://www.codeofhonor.com/blog/the-starcraft-path-finding-...

> whenever harvesters are on their way to get minerals, or when they’re on the way back carrying those minerals, they ignore collisions with other units

Maybe that's part of the fluid behaviour you noticed.

The blog contains more technical posts about StarCraft 2, so you might find that "special sauce" somewhere else in there :)
adastral
·2 года назад·discuss
Not sure if this is what the above comment means by "atomic", but a shortcoming of Postgres' JSON support is that it will have to rewrite an entire JSON object every time a part of it gets updated, no matter how many keys the update really affected. E.g. if I update an integer in a 100MB JSON object, Postgres will write ~100MB (plus WAL, TOAST overhead, etc.), not just a few bytes. I imagine this can be a no-go for certain use cases.
adastral
·2 года назад·discuss
Around ten heavily-updated (50-400k updated rows/min) tables ranging between 500M and 5B rows, with a couple tables over 40B rows each (5TB each IIRC).
adastral
·2 года назад·discuss
I see they don't mention Citus (https://github.com/citusdata/citus), which is already a fairly mature native Postgres extension. From the details given in the article, it sounds like they just reimplemented it.

I wonder if they were unaware of it or disregarded it for a reason —I currently am in a similar situation as the one described in the blog, trying to shard a massive Postgres DB.
adastral
·2 года назад·discuss
> they'll be encrypted

Since some months (years?) ago, WhatsApp lets you set up your own encryption password for the DB backup. I set one up and used https://github.com/ElDavoo/wa-crypt-tools to get access to the decrypted SQLite and run some analytics over my messages :)