HackerTrans
TopNewTrendsCommentsPastAskShowJobs

adastral

no profile record

Submissions

Pg_hardstorage: PostgreSQL Backup, Done Right

github.com
5 points·by adastral·21 ngày trước·0 comments

RawTree

rawtree.com
3 points·by adastral·tháng trước·0 comments

We moved our growth analytics back into Tinybird

tinybird.co
3 points·by adastral·tháng trước·0 comments

Key Joins (SQL Proposal)

keyjoin.org
2 points·by adastral·2 tháng trước·0 comments

Git-worktree – Manage multiple working trees

git-scm.com
8 points·by adastral·11 tháng trước·0 comments

Benchmarking Is Hard, Sometimes

vondra.me
2 points·by adastral·năm ngoái·0 comments

Decomposing Transactional Systems

transactional.blog
18 points·by adastral·năm ngoái·0 comments

Dynamically estimating and scaling Postgres' working set size (2024)

neon.tech
2 points·by adastral·năm ngoái·0 comments

AWS CloudWatch and AWS OpenSearch launch an integrated analytics experience

aws.amazon.com
2 points·by adastral·2 năm trước·0 comments

comments

adastral
·10 tháng trước·discuss
PostgresTV livestreams "vibe coding" 1h sessions implementing small PostgreSQL features with Cursor (mostly claude-4-sonnet model) every week, by experienced PostgreSQL contributors. [0] is their latest stream.

I personally have not watched much, but it sounds just like what you are looking for!

[0] https://www.youtube.com/watch?v=3MleDtXZUlM
adastral
·2 năm trước·discuss
> I default to a headless browser

Headless browsers consume orders of magnitude more resources, and execute far more requests (e.g. fetching images) than a common webscraping job would require. Having run webscraping at scale myself, the cost of operating headless browsers made us only use them as a last resort.
adastral
·2 năm trước·discuss
From https://www.codeofhonor.com/blog/the-starcraft-path-finding-...

> whenever harvesters are on their way to get minerals, or when they’re on the way back carrying those minerals, they ignore collisions with other units

Maybe that's part of the fluid behaviour you noticed.

The blog contains more technical posts about StarCraft 2, so you might find that "special sauce" somewhere else in there :)
adastral
·2 năm trước·discuss
Not sure if this is what the above comment means by "atomic", but a shortcoming of Postgres' JSON support is that it will have to rewrite an entire JSON object every time a part of it gets updated, no matter how many keys the update really affected. E.g. if I update an integer in a 100MB JSON object, Postgres will write ~100MB (plus WAL, TOAST overhead, etc.), not just a few bytes. I imagine this can be a no-go for certain use cases.
adastral
·2 năm trước·discuss
Around ten heavily-updated (50-400k updated rows/min) tables ranging between 500M and 5B rows, with a couple tables over 40B rows each (5TB each IIRC).
adastral
·2 năm trước·discuss
I see they don't mention Citus (https://github.com/citusdata/citus), which is already a fairly mature native Postgres extension. From the details given in the article, it sounds like they just reimplemented it.

I wonder if they were unaware of it or disregarded it for a reason —I currently am in a similar situation as the one described in the blog, trying to shard a massive Postgres DB.
adastral
·2 năm trước·discuss
> they'll be encrypted

Since some months (years?) ago, WhatsApp lets you set up your own encryption password for the DB backup. I set one up and used https://github.com/ElDavoo/wa-crypt-tools to get access to the decrypted SQLite and run some analytics over my messages :)