Even if this were to change, using object storage results in a lot of operational simplicity as well compared to managing a bunch of disks. You can easily and quickly scale to zero or scale up to handle bursts in traffic.
An architecture like this also makes it possible to achieve a truly active-active multi-region Kafka cluster that has real SLAs.
gRPC ships with its own networking stack, which is one reason why those libs are heavy. Connect libraries leverage each ecosystem's native networking stack (e.g. net/http in Go, NSURLSession in Swift, etc.), which means any other libraries that work with the standard networking stack interop well with Connect.
Buf | Software Engineer (Frontend or Infrastructure) | Remote (US or Canada) | Full time | https://buf.build/
Buf is building a Protobuf platform that provides end-to-end type safety and governance across all APIs and streaming data in Kafka. We’re deployed everywhere from small startups to the world’s largest enterprises, and we’re hiring to scale our growing business.
Tech stack: Go, TypeScript, Kubernetes
If you are interested to work at Buf, apply to one of our open roles here:
https://buf.build/careers
Buf | Software Engineer (Infrastructure, Go backend), Engineering Manager (Infrastructure) | Remote (US or Canada) | Full time | https://buf.build/
Buf is building a Protobuf platform that provides end-to-end type safety and governance across all APIs and streaming data in Kafka. We’re deployed everywhere from small startups to the world’s largest enterprises, and we’re hiring to scale our growing business.
Tech stack: Go, TypeScript, Kubernetes
If you are interested to help us build out our infrastructure platform or work on Bufstream (our drop-in replacement for Kafka that is 10x cheaper), apply here:
https://buf.build/careers
Buf | Software Engineer, Engineering Manager | Remote (US or Canada) | Full time | https://buf.build
Buf is building a new paradigm for APIs. Our open source and commercial software helps companies adopt Protobuf schemas throughout their stack, from gRPC APIs to streaming data in Kafka. We’re deployed everywhere from small startups to the world’s largest enterprises, and we’re hiring to scale our growing business.
Even if this were to change, using object storage results in a lot of operational simplicity as well compared to managing a bunch of disks. You can easily and quickly scale to zero or scale up to handle bursts in traffic.
An architecture like this also makes it possible to achieve a truly active-active multi-region Kafka cluster that has real SLAs.
See: https://buf.build/blog/bufstream-multi-region
(disclosure: I work at Buf)