HackerTrans
TopNewTrendsCommentsPastAskShowJobs

adastral

no profile record

Submissions

Pg_hardstorage: PostgreSQL Backup, Done Right

github.com
5 points·by adastral·21 दिन पहले·0 comments

RawTree

rawtree.com
3 points·by adastral·पिछला माह·0 comments

We moved our growth analytics back into Tinybird

tinybird.co
3 points·by adastral·पिछला माह·0 comments

Key Joins (SQL Proposal)

keyjoin.org
2 points·by adastral·2 माह पहले·0 comments

Git-worktree – Manage multiple working trees

git-scm.com
8 points·by adastral·11 माह पहले·0 comments

Benchmarking Is Hard, Sometimes

vondra.me
2 points·by adastral·पिछला वर्ष·0 comments

Decomposing Transactional Systems

transactional.blog
18 points·by adastral·पिछला वर्ष·0 comments

Dynamically estimating and scaling Postgres' working set size (2024)

neon.tech
2 points·by adastral·पिछला वर्ष·0 comments

AWS CloudWatch and AWS OpenSearch launch an integrated analytics experience

aws.amazon.com
2 points·by adastral·2 वर्ष पहले·0 comments

comments

adastral
·10 माह पहले·discuss
PostgresTV livestreams "vibe coding" 1h sessions implementing small PostgreSQL features with Cursor (mostly claude-4-sonnet model) every week, by experienced PostgreSQL contributors. [0] is their latest stream.

I personally have not watched much, but it sounds just like what you are looking for!

[0] https://www.youtube.com/watch?v=3MleDtXZUlM
adastral
·2 वर्ष पहले·discuss
> I default to a headless browser

Headless browsers consume orders of magnitude more resources, and execute far more requests (e.g. fetching images) than a common webscraping job would require. Having run webscraping at scale myself, the cost of operating headless browsers made us only use them as a last resort.
adastral
·2 वर्ष पहले·discuss
From https://www.codeofhonor.com/blog/the-starcraft-path-finding-...

> whenever harvesters are on their way to get minerals, or when they’re on the way back carrying those minerals, they ignore collisions with other units

Maybe that's part of the fluid behaviour you noticed.

The blog contains more technical posts about StarCraft 2, so you might find that "special sauce" somewhere else in there :)
adastral
·2 वर्ष पहले·discuss
Not sure if this is what the above comment means by "atomic", but a shortcoming of Postgres' JSON support is that it will have to rewrite an entire JSON object every time a part of it gets updated, no matter how many keys the update really affected. E.g. if I update an integer in a 100MB JSON object, Postgres will write ~100MB (plus WAL, TOAST overhead, etc.), not just a few bytes. I imagine this can be a no-go for certain use cases.
adastral
·2 वर्ष पहले·discuss
Around ten heavily-updated (50-400k updated rows/min) tables ranging between 500M and 5B rows, with a couple tables over 40B rows each (5TB each IIRC).
adastral
·2 वर्ष पहले·discuss
I see they don't mention Citus (https://github.com/citusdata/citus), which is already a fairly mature native Postgres extension. From the details given in the article, it sounds like they just reimplemented it.

I wonder if they were unaware of it or disregarded it for a reason —I currently am in a similar situation as the one described in the blog, trying to shard a massive Postgres DB.
adastral
·2 वर्ष पहले·discuss
> they'll be encrypted

Since some months (years?) ago, WhatsApp lets you set up your own encryption password for the DB backup. I set one up and used https://github.com/ElDavoo/wa-crypt-tools to get access to the decrypted SQLite and run some analytics over my messages :)