Ask HN: Edge Computing, a Half-Solved Puzzle?
3 comments
> Now we face new challenges: figuring out which data should be moved to the edge, finding efficient ways to transfer data from centralized data centers to the edge, and keeping everything in sync.
Why would you need to do this? D1 is meant to be a complete database and intention is to host everything there.
> However, when you involve a database, this advantage starts to fade away.
Why? Define database and what your needs are. Dynamodb or Cosmosdb for example can be multi-region read/write databases. You can deploy it in every region supported if you need to. What is missing?
Other examples...
- Mongo Atlas (hosted mongodb) supports global multi-region.
- Astradb (hosted cassandra) supports global multi-region.
- Cockroachdb supports global multi-region. It has a more interesting approach of allowing you to specify the "home" region per row.
Why would you need to do this? D1 is meant to be a complete database and intention is to host everything there.
> However, when you involve a database, this advantage starts to fade away.
Why? Define database and what your needs are. Dynamodb or Cosmosdb for example can be multi-region read/write databases. You can deploy it in every region supported if you need to. What is missing?
Other examples...
- Mongo Atlas (hosted mongodb) supports global multi-region.
- Astradb (hosted cassandra) supports global multi-region.
- Cockroachdb supports global multi-region. It has a more interesting approach of allowing you to specify the "home" region per row.
D1 is currently limited to 100 MB, and I'm doubtful it's meant to be a complete database. As I understand it, it's more for "manual cache" purposes and not for hosting everything there (think about 100 TB of data).
Regarding your second comment, while it's true that all the solutions you mentioned allow you to deploy a DB, they are offering between 5-10 locations around the world, compared to 100+ locations of Edge solutions.
Anyway, that's not the main point. I still don't think it's the right way to create read replicas for all your data in all locations. There should be a better way to copy only the relevant data (the data you want to fetch with low latency).
Regarding your second comment, while it's true that all the solutions you mentioned allow you to deploy a DB, they are offering between 5-10 locations around the world, compared to 100+ locations of Edge solutions.
Anyway, that's not the main point. I still don't think it's the right way to create read replicas for all your data in all locations. There should be a better way to copy only the relevant data (the data you want to fetch with low latency).
Until we go interplanetary[0] —or unless you have a very time-sensitive database application— it's already[1] all edge.
[0] lunar would also work
[1] I consistently get <300ms pings to servers 12 time zones away. But I grew up in an era when long-distance (tens of km) phone calls were exorbitantly expensive, causing us to wait to transfer data for night rates, so YMMV.
[0] lunar would also work
[1] I consistently get <300ms pings to servers 12 time zones away. But I grew up in an era when long-distance (tens of km) phone calls were exorbitantly expensive, causing us to wait to transfer data for night rates, so YMMV.
The idea behind edge computing is to provide faster response times by running logic close to the end user, reducing data travel distance. However, when you involve a database, this advantage starts to fade away. In fact, things can even get worse because the amount of data moving between the edge and the database is often more than what's exchanged between the edge and the user.
To tackle this, companies have started appearing at the edge too. Companies like turso.tech, Cloudflare (D1), and Fly.io let us deploy databases at various edge locations worldwide. But even with this approach, we're only solving part of the problem (!)
Now we face new challenges: figuring out which data should be moved to the edge, finding efficient ways to transfer data from centralized data centers to the edge, and keeping everything in sync.
Are there any companies working on this? Or am I missing something? I'd love to hear your thoughts and insights.