HackerTrans
トップ新着トレンドコメント過去質問紹介求人

tee-es-gee

no profile record

投稿

[untitled]

1 ポイント·投稿者 tee-es-gee·先月·0 コメント

Show HN: Pg_deltax, Apache-licensed alternative to TimescaleDB

github.com
39 ポイント·投稿者 tee-es-gee·2 か月前·1 コメント

Postgres minor releases closing 11 CVEs

postgresql.org
26 ポイント·投稿者 tee-es-gee·2 か月前·0 コメント

[untitled]

1 ポイント·投稿者 tee-es-gee·2 か月前·0 コメント

Xatastor: ZFS and NVMe-Of for Postgres Databases

xata.io
6 ポイント·投稿者 tee-es-gee·2 か月前·0 コメント

Code review advice for vibe coders

xata.io
3 ポイント·投稿者 tee-es-gee·3 か月前·0 コメント

Xata – open-source, cloud native, Postgres platform

github.com
3 ポイント·投稿者 tee-es-gee·3 か月前·0 コメント

Open source Postgres platform with branching

xata.io
2 ポイント·投稿者 tee-es-gee·3 か月前·0 コメント

Postgres copy-on-write branching explained

xata.io
1 ポイント·投稿者 tee-es-gee·3 か月前·0 コメント

What if database branching was easy?

xata.io
70 ポイント·投稿者 tee-es-gee·3 か月前·57 コメント

What if database branching was easy?

xata.io
2 ポイント·投稿者 tee-es-gee·3 か月前·0 コメント

Show HN: Xata, open-source Postgres platform with copy-on-write branches

github.com
4 ポイント·投稿者 tee-es-gee·3 か月前·0 コメント

コメント

tee-es-gee
·2 か月前·議論
It looks like pgBackRest will likely continue, multiple companies are stepping up with sponsorships. Mentioning this just in case anyone is making plans to move away, it's probably worth waiting a bit for things to settle.
tee-es-gee
·3 か月前·議論
I do think that as service providers we now have a new "attack vector" to be worried about. Up to now, having an API that deletes the whole volume, including backups, might have been acceptable, because generally users won't do such a destructive action via the API or if they do, they likely understand the consequences. Or at the very least don't complain if they do it without reading the docs carefully enough.

But now agents are overly eager to solve the problem and can be quite resourceful in finding an API to "start from clean-slate" to fix it.
tee-es-gee
·3 か月前·議論
I agree and hope this is the case for anything serious enough. I also don't see this changing any time soon.

There are ways to give safe access to the data, at least read-only, that don't involve production risk and don't sacrifice privacy. For example, database branches with anonymization. Instead of accessing the prod/staging db, the agent creates a branch and has read/write access to that.

(disclaimer: I work at Xata, where we offer copy-on-write branches for Postgres, and the agent use-cases are the most popular right now)
tee-es-gee
·3 か月前·議論
Looks interesting! Do you have ClickBench results or similar?

> Everything in core, no extensions. HTTP(S), S3 (anonymous public reads), Avro, Excel, Arrow, and SQLite read through the same core binary - no separate install/load step.

That is not so good for an embedded database, though, opens security concerns.
tee-es-gee
·3 か月前·議論
I will follow this one for sure. There are a few more companies with the extremely ambitious goal of "a better AWS", and I am interested in the various strategies they take to approach that goal incrementally.

A service offering VMs for $20 is a long way from AWS, but I see how it makes sense as a first step. AWS also started with EC2, but in a completely different environment with no competition.
tee-es-gee
·3 か月前·議論
Nice article! From what I understand, you computed the bloom values in the application layer, right? Would https://www.postgresql.org/docs/current/bloom.html have worked as well?
tee-es-gee
·3 か月前·議論
Got it, yes, I've seen in the other comment that you're referring to the new Postgres 18 feature. If that works for you in local dev, so much the better :)
tee-es-gee
·3 か月前·議論
Yes, for sure, and stuff like this is really useful when rebalancing storage nodes, for example.

My point is that for the use case of offering a Postgres service with CoW branching as a key feature, you can't really escape some form of separation of storage and compute.

Btw, don't really want to talk too much about it yet, but our proprietary storage engine (Xatastor) is basically ZFS exposed over NVMe-OF. We'll announce it in a couple of weeks, and we'll have a detailed technical blog post then on pros/cons.
tee-es-gee
·3 か月前·議論
We have an overview on how it works here: https://xata.io/blog/open-source-postgres-branching-copy-on-...
tee-es-gee
·3 か月前·議論
> You don’t need anything but vanilla pg and a supported file system to do it anymore; just clone the database using a template and a newish version of Postgres.

Are you referring to `file_copy_method = clone` from Postgres 18? For example: https://boringsql.com/posts/instant-database-clones/

I think the key limitation is:

> The source database can't have any active connections during cloning. This is a PostgreSQL limitation, not a filesystem one.
tee-es-gee
·3 か月前·議論
Xata is open source btw (open core): https://github.com/xataio/xata
tee-es-gee
·3 か月前·議論
For context for the others, I think you are referring to this blog post: https://xata.io/blog/open-source-postgres-branching-copy-on-... (in particular the "The key is in the storage system" section) right?

What I'm saying there is that if you do Postgres with on top of a local ZFS volume, the child branches Postgres instances need to be on the same server. So you are limited in how many branches you can do. One or two are fine, but if you want to do a branch per PR, that will likely not work.

If you separate the compute from storage via the network, this problem goes away.