HackerTrans
TopNewTrendsCommentsPastAskShowJobs

tee-es-gee

no profile record

Submissions

[untitled]

1 points·by tee-es-gee·30 giorni fa·0 comments

Show HN: Pg_deltax, Apache-licensed alternative to TimescaleDB

github.com
39 points·by tee-es-gee·2 mesi fa·1 comments

Postgres minor releases closing 11 CVEs

postgresql.org
26 points·by tee-es-gee·2 mesi fa·0 comments

[untitled]

1 points·by tee-es-gee·2 mesi fa·0 comments

Xatastor: ZFS and NVMe-Of for Postgres Databases

xata.io
6 points·by tee-es-gee·2 mesi fa·0 comments

Code review advice for vibe coders

xata.io
3 points·by tee-es-gee·3 mesi fa·0 comments

Xata – open-source, cloud native, Postgres platform

github.com
3 points·by tee-es-gee·3 mesi fa·0 comments

Open source Postgres platform with branching

xata.io
2 points·by tee-es-gee·3 mesi fa·0 comments

Postgres copy-on-write branching explained

xata.io
1 points·by tee-es-gee·3 mesi fa·0 comments

What if database branching was easy?

xata.io
70 points·by tee-es-gee·3 mesi fa·57 comments

What if database branching was easy?

xata.io
2 points·by tee-es-gee·3 mesi fa·0 comments

Show HN: Xata, open-source Postgres platform with copy-on-write branches

github.com
4 points·by tee-es-gee·3 mesi fa·0 comments

comments

tee-es-gee
·2 mesi fa·discuss
It looks like pgBackRest will likely continue, multiple companies are stepping up with sponsorships. Mentioning this just in case anyone is making plans to move away, it's probably worth waiting a bit for things to settle.
tee-es-gee
·3 mesi fa·discuss
I do think that as service providers we now have a new "attack vector" to be worried about. Up to now, having an API that deletes the whole volume, including backups, might have been acceptable, because generally users won't do such a destructive action via the API or if they do, they likely understand the consequences. Or at the very least don't complain if they do it without reading the docs carefully enough.

But now agents are overly eager to solve the problem and can be quite resourceful in finding an API to "start from clean-slate" to fix it.
tee-es-gee
·3 mesi fa·discuss
I agree and hope this is the case for anything serious enough. I also don't see this changing any time soon.

There are ways to give safe access to the data, at least read-only, that don't involve production risk and don't sacrifice privacy. For example, database branches with anonymization. Instead of accessing the prod/staging db, the agent creates a branch and has read/write access to that.

(disclaimer: I work at Xata, where we offer copy-on-write branches for Postgres, and the agent use-cases are the most popular right now)
tee-es-gee
·3 mesi fa·discuss
Looks interesting! Do you have ClickBench results or similar?

> Everything in core, no extensions. HTTP(S), S3 (anonymous public reads), Avro, Excel, Arrow, and SQLite read through the same core binary - no separate install/load step.

That is not so good for an embedded database, though, opens security concerns.
tee-es-gee
·3 mesi fa·discuss
I will follow this one for sure. There are a few more companies with the extremely ambitious goal of "a better AWS", and I am interested in the various strategies they take to approach that goal incrementally.

A service offering VMs for $20 is a long way from AWS, but I see how it makes sense as a first step. AWS also started with EC2, but in a completely different environment with no competition.
tee-es-gee
·3 mesi fa·discuss
Nice article! From what I understand, you computed the bloom values in the application layer, right? Would https://www.postgresql.org/docs/current/bloom.html have worked as well?
tee-es-gee
·3 mesi fa·discuss
Got it, yes, I've seen in the other comment that you're referring to the new Postgres 18 feature. If that works for you in local dev, so much the better :)
tee-es-gee
·3 mesi fa·discuss
Yes, for sure, and stuff like this is really useful when rebalancing storage nodes, for example.

My point is that for the use case of offering a Postgres service with CoW branching as a key feature, you can't really escape some form of separation of storage and compute.

Btw, don't really want to talk too much about it yet, but our proprietary storage engine (Xatastor) is basically ZFS exposed over NVMe-OF. We'll announce it in a couple of weeks, and we'll have a detailed technical blog post then on pros/cons.
tee-es-gee
·3 mesi fa·discuss
We have an overview on how it works here: https://xata.io/blog/open-source-postgres-branching-copy-on-...
tee-es-gee
·3 mesi fa·discuss
> You don’t need anything but vanilla pg and a supported file system to do it anymore; just clone the database using a template and a newish version of Postgres.

Are you referring to `file_copy_method = clone` from Postgres 18? For example: https://boringsql.com/posts/instant-database-clones/

I think the key limitation is:

> The source database can't have any active connections during cloning. This is a PostgreSQL limitation, not a filesystem one.
tee-es-gee
·3 mesi fa·discuss
Xata is open source btw (open core): https://github.com/xataio/xata
tee-es-gee
·3 mesi fa·discuss
For context for the others, I think you are referring to this blog post: https://xata.io/blog/open-source-postgres-branching-copy-on-... (in particular the "The key is in the storage system" section) right?

What I'm saying there is that if you do Postgres with on top of a local ZFS volume, the child branches Postgres instances need to be on the same server. So you are limited in how many branches you can do. One or two are fine, but if you want to do a branch per PR, that will likely not work.

If you separate the compute from storage via the network, this problem goes away.