HackerTrans
TopNewTrendsCommentsPastAskShowJobs

tee-es-gee

no profile record

Submissions

[untitled]

1 points·by tee-es-gee·30 дней назад·0 comments

Show HN: Pg_deltax, Apache-licensed alternative to TimescaleDB

github.com
39 points·by tee-es-gee·2 месяца назад·1 comments

Postgres minor releases closing 11 CVEs

postgresql.org
26 points·by tee-es-gee·2 месяца назад·0 comments

[untitled]

1 points·by tee-es-gee·2 месяца назад·0 comments

Xatastor: ZFS and NVMe-Of for Postgres Databases

xata.io
6 points·by tee-es-gee·2 месяца назад·0 comments

Code review advice for vibe coders

xata.io
3 points·by tee-es-gee·3 месяца назад·0 comments

Xata – open-source, cloud native, Postgres platform

github.com
3 points·by tee-es-gee·3 месяца назад·0 comments

Open source Postgres platform with branching

xata.io
2 points·by tee-es-gee·3 месяца назад·0 comments

Postgres copy-on-write branching explained

xata.io
1 points·by tee-es-gee·3 месяца назад·0 comments

What if database branching was easy?

xata.io
70 points·by tee-es-gee·3 месяца назад·57 comments

What if database branching was easy?

xata.io
2 points·by tee-es-gee·3 месяца назад·0 comments

Show HN: Xata, open-source Postgres platform with copy-on-write branches

github.com
4 points·by tee-es-gee·3 месяца назад·0 comments

comments

tee-es-gee
·2 месяца назад·discuss
It looks like pgBackRest will likely continue, multiple companies are stepping up with sponsorships. Mentioning this just in case anyone is making plans to move away, it's probably worth waiting a bit for things to settle.
tee-es-gee
·3 месяца назад·discuss
I do think that as service providers we now have a new "attack vector" to be worried about. Up to now, having an API that deletes the whole volume, including backups, might have been acceptable, because generally users won't do such a destructive action via the API or if they do, they likely understand the consequences. Or at the very least don't complain if they do it without reading the docs carefully enough.

But now agents are overly eager to solve the problem and can be quite resourceful in finding an API to "start from clean-slate" to fix it.
tee-es-gee
·3 месяца назад·discuss
I agree and hope this is the case for anything serious enough. I also don't see this changing any time soon.

There are ways to give safe access to the data, at least read-only, that don't involve production risk and don't sacrifice privacy. For example, database branches with anonymization. Instead of accessing the prod/staging db, the agent creates a branch and has read/write access to that.

(disclaimer: I work at Xata, where we offer copy-on-write branches for Postgres, and the agent use-cases are the most popular right now)
tee-es-gee
·3 месяца назад·discuss
Looks interesting! Do you have ClickBench results or similar?

> Everything in core, no extensions. HTTP(S), S3 (anonymous public reads), Avro, Excel, Arrow, and SQLite read through the same core binary - no separate install/load step.

That is not so good for an embedded database, though, opens security concerns.
tee-es-gee
·3 месяца назад·discuss
I will follow this one for sure. There are a few more companies with the extremely ambitious goal of "a better AWS", and I am interested in the various strategies they take to approach that goal incrementally.

A service offering VMs for $20 is a long way from AWS, but I see how it makes sense as a first step. AWS also started with EC2, but in a completely different environment with no competition.
tee-es-gee
·3 месяца назад·discuss
Nice article! From what I understand, you computed the bloom values in the application layer, right? Would https://www.postgresql.org/docs/current/bloom.html have worked as well?
tee-es-gee
·3 месяца назад·discuss
Got it, yes, I've seen in the other comment that you're referring to the new Postgres 18 feature. If that works for you in local dev, so much the better :)
tee-es-gee
·3 месяца назад·discuss
Yes, for sure, and stuff like this is really useful when rebalancing storage nodes, for example.

My point is that for the use case of offering a Postgres service with CoW branching as a key feature, you can't really escape some form of separation of storage and compute.

Btw, don't really want to talk too much about it yet, but our proprietary storage engine (Xatastor) is basically ZFS exposed over NVMe-OF. We'll announce it in a couple of weeks, and we'll have a detailed technical blog post then on pros/cons.
tee-es-gee
·3 месяца назад·discuss
We have an overview on how it works here: https://xata.io/blog/open-source-postgres-branching-copy-on-...
tee-es-gee
·3 месяца назад·discuss
> You don’t need anything but vanilla pg and a supported file system to do it anymore; just clone the database using a template and a newish version of Postgres.

Are you referring to `file_copy_method = clone` from Postgres 18? For example: https://boringsql.com/posts/instant-database-clones/

I think the key limitation is:

> The source database can't have any active connections during cloning. This is a PostgreSQL limitation, not a filesystem one.
tee-es-gee
·3 месяца назад·discuss
Xata is open source btw (open core): https://github.com/xataio/xata
tee-es-gee
·3 месяца назад·discuss
For context for the others, I think you are referring to this blog post: https://xata.io/blog/open-source-postgres-branching-copy-on-... (in particular the "The key is in the storage system" section) right?

What I'm saying there is that if you do Postgres with on top of a local ZFS volume, the child branches Postgres instances need to be on the same server. So you are limited in how many branches you can do. One or two are fine, but if you want to do a branch per PR, that will likely not work.

If you separate the compute from storage via the network, this problem goes away.