Code Everywhere: Why We Built Cloudflare Workers(blog.cloudflare.com)
blog.cloudflare.com
Code Everywhere: Why We Built Cloudflare Workers
https://blog.cloudflare.com/code-everywhere-cloudflare-workers/
27 comments
Yes. We are that big.
https://bgp.he.net/report/exchanges#_participants
https://bgp.he.net/report/exchanges#_participants
"Most peered"?
Another day another dubious Cloudflare marketing claim.
Participating in the most IXs does not mean you have the most BGP peers. Simply participating in an IX does not mean that every other participating network at that IX automatically agrees to peer with you. Using AMS-IX as an example:
"Every member or customer at AMS-IX is in the position to peer with any or all other connected ISP's although they are not required to"[1]
And this is pretty standard across all IXs.
For instance Facebook might be far down that chart regarding the number of IX fabrics they peer at but if 99% of of the participants at those agree to peer with them there then they are likely "more peered" than you.
[1] https://ams-ix.net/faqs
Another day another dubious Cloudflare marketing claim.
Participating in the most IXs does not mean you have the most BGP peers. Simply participating in an IX does not mean that every other participating network at that IX automatically agrees to peer with you. Using AMS-IX as an example:
"Every member or customer at AMS-IX is in the position to peer with any or all other connected ISP's although they are not required to"[1]
And this is pretty standard across all IXs.
For instance Facebook might be far down that chart regarding the number of IX fabrics they peer at but if 99% of of the participants at those agree to peer with them there then they are likely "more peered" than you.
[1] https://ams-ix.net/faqs
But this only counts IX peers I guess? Google, Amazon, Facebook will peer privately with most ISPs.
Very similar to lambda@edge
Trade offs I see
* Cloudflare is probably slightly closer to customers, but cloudfront is still very close
* lambda@edge should be cheaper with amazons scale and ecosystem
* cloudfront itself is very expensive compared to Cloudflare, almost every project can integrate Cloudflare and use this, where small projects don’t really make sense for cloudfront
Trade offs I see
* Cloudflare is probably slightly closer to customers, but cloudfront is still very close
* lambda@edge should be cheaper with amazons scale and ecosystem
* cloudfront itself is very expensive compared to Cloudflare, almost every project can integrate Cloudflare and use this, where small projects don’t really make sense for cloudfront
> lambda@edge should be cheaper with amazons scale and ecosystem
I suspect price will have more to do with the tech's underlying ability to scale to lots of (separately-sandboxed) customers at lots of edge locations. Our tech is pretty different from Amazon's so it will be interesting to see how that shakes out.
I suspect price will have more to do with the tech's underlying ability to scale to lots of (separately-sandboxed) customers at lots of edge locations. Our tech is pretty different from Amazon's so it will be interesting to see how that shakes out.
It would be amazing if those workers supported WebSockets. Running game servers in them would be tempting, as long as they don't charge exorbitant prices for bandwidth.
WebSocket support is planned (not sure if it will be in v1).
The issue with game servers is that you probably need to make sure all the players in the same game instance hit the same worker. There won't be any way to do that with workers in v1. But, this is definitely something we've thought about, and as a big gamer myself I would like to see it happen someday. I have some particular ideas for a different kind of worker (not a Service Worker) that serves this use case. But it's probably a year out.
The issue with game servers is that you probably need to make sure all the players in the same game instance hit the same worker. There won't be any way to do that with workers in v1. But, this is definitely something we've thought about, and as a big gamer myself I would like to see it happen someday. I have some particular ideas for a different kind of worker (not a Service Worker) that serves this use case. But it's probably a year out.
Can you add an update for your game, Diepio? Like a balance change?
This is pretty interesting, especially if one get some kind og local storage where one can cache the data from the users and also keep some extra data one need to handle the requests.
One can also imagine some kind of MQ solution that distribute to the edges and then updates the clients (for games and such scenarios)
Yes. We are exploring adding data storage at the edge. We would love people’s feedback in the product and what features we need to add.
I guess the most valuable while still feasible thing would be a distributed eventually consistent key-value store (ideally with no-nonsense pricing: just per pay read/write/delete, with a single unit cost regardless how small or big you are - but please do provide an efficient way to delete the entire db, unlike GC Datastore).
Maybe different tariffs based on the percentage of reads that you can serve locally, the average latency or something similar, in order to avoid having to replicate every piece of data to every edge?
Maybe different tariffs based on the percentage of reads that you can serve locally, the average latency or something similar, in order to avoid having to replicate every piece of data to every edge?
It sounds like you're slowly working towards becoming some sort of insane hosting company
I don’t see us going into hosting. I do see us doing everything that makes sense when you are a few ms from everyone on the planet.
> Run JavaScript Service Workers at the Edge
> We are exploring adding data storage at the edge.
> I don’t see us going into hosting.
You must have your eyes closed then, because that's clearly pushing the camel nose into the Amazon lambda tent.
> We are exploring adding data storage at the edge.
> I don’t see us going into hosting.
You must have your eyes closed then, because that's clearly pushing the camel nose into the Amazon lambda tent.
How does this deal with proxy loops?
As an example, I would assume worker is making requests with the internal view of the site, but can not have an internal view of other sites or security problems would ensue.. So what happens when two of my sites have service workers fetching something from each other on each request?
As an example, I would assume worker is making requests with the internal view of the site, but can not have an internal view of other sites or security problems would ensue.. So what happens when two of my sites have service workers fetching something from each other on each request?
As you guessed, when your worker makes a subrequest to your own zone, it goes directly to your origin server, but when you subrequest to some other domain, it goes in "the front door", and that other domain's scripts apply.
If a request bounces back such that the same worker script would need to run twice as a result of a single original request, then it fails with an error. There's nothing else we can do here: we can't let the request loop, but we also can't let it skip your script after it's bounced through a third-party script.
If a request bounces back such that the same worker script would need to run twice as a result of a single original request, then it fails with an error. There's nothing else we can do here: we can't let the request loop, but we also can't let it skip your script after it's bounced through a third-party script.
To clarify, yesterday you mentioned that subrequests go through the regular caching subsystem.
Does this hold true even for subrequests to your own zone, where you say here that they go directly to the origin server?
Does this hold true even for subrequests to your own zone, where you say here that they go directly to the origin server?
Yes. I meant that those requests don't loop back into the Worker again -- I didn't mean that they skip cache.
[deleted]
Summary: Service Workers on the Edge Server.
Very interesting, especially since it allows for a Cloudflare ESI system.
Wonder if many will take advantage of it
Very interesting, especially since it allows for a Cloudflare ESI system.
Wonder if many will take advantage of it
What is ESI in this context? Edge Server Infrastructure?
Edge Side Includes. Imagine putting some sort of template syntax in a file, that file is cached, and when it's called from cache it grabs a file from the remote server based on the template syntax.
Notably, implementing ESI directly at Cloudflare's edge enables them to cache page fragments, rather than fully constructed pages.
That could do wonders both for the size of caches and for cache hit-rates
That could do wonders both for the size of caches and for cache hit-rates
[deleted]
That's a bold claim. I'd expect Akamai, Google and Amazon to be peered at more locations, maybe even more. Or have they become that big?