MongoDB deprecates Atlas Device sync(mongodb.com)
mongodb.com
MongoDB deprecates Atlas Device sync
https://www.mongodb.com/products/updates/product-support-deprecation
14 comments
Hi, I'm Srushtika, PM at Ably. I'm investigating how Ably might be able to help here with some of our existing and upcoming products. Would love to understand how folks have been using DeviceSync so far. Please feel free to reach out: https://www.linkedin.com/in/srushtika/
I am genuinely sad this news does not seem to have gained much traction. I think the technology itself is great and that makes the deprecation announcement so surprising.
We were weeks away from announcing a new product based on Atlas Flexible Sync. Now the project's fate is hanging in the balance.
We were weeks away from announcing a new product based on Atlas Flexible Sync. Now the project's fate is hanging in the balance.
Really devastating. I think the rename from Realm is why people haven't noticed this, but I guess also its popularity really has dwindled. Even though I only use local RealmSwift, I don't trust that the community will be able to keep it going even in maintenance mode.
Anybody else here using this actively? What are your migration plans?
Yes,I already had to migrate from Realm to MongoDB Realm and now again to another solution. I'm looking into Firebase Real-time database hoping they have more stability and is not changing the ownership every 5 years
Brutal :') As Firebase is a Google product it's pretty far down my list in terms of reliable alternatives. But I may check it out as well after I see how a migration to Ditto looks.
Found this additional news that it will possibly be merged into Ditto: https://www.linkedin.com/pulse/meet-ditto-company-replacing-...
Adam (CEO of Ditto) here, Mongo is transitioning to a partner-first strategy for mobile and edge applications. We are working closely with Mongo to create a cohesive product experience between Ditto and Mongo Atlas. High-level that is a supported bidirectional connector between Atlas and Ditto's Edge Sync platform.
Furthermore, we are working with customers of Atlas Device Sync to help and support them in the transition. There are aspects of Ditto different than Realm - most prominent is that we are schema-less. This will mean some client-side code transition, but longer-term a tighter alignment with Mongo Atlas. We are excited as well to introduce more to Ditto's unique capability of P2P device sync.
Note, I previously worked at Realm before the Mongo acquisition and even before joining the team I was an avid fan of the database. I hope it continues life via the community!
Would love anyone to give Ditto a try, you can sign up for free here: https://portal.ditto.live/
Furthermore, we are working with customers of Atlas Device Sync to help and support them in the transition. There are aspects of Ditto different than Realm - most prominent is that we are schema-less. This will mean some client-side code transition, but longer-term a tighter alignment with Mongo Atlas. We are excited as well to introduce more to Ditto's unique capability of P2P device sync.
Note, I previously worked at Realm before the Mongo acquisition and even before joining the team I was an avid fan of the database. I hope it continues life via the community!
Would love anyone to give Ditto a try, you can sign up for free here: https://portal.ditto.live/
Hi Adam,
It is great to know that there's a logical successor.
As I mentioned above, I work in a company that offers a SAAS that's based on the Device Sync solution. We were weeks away from announcing a collaboration-oriented product based on Atlas, but now these plans are in shambles.
We are actively looking into Ditto now, and the P2P approach to sync is genuinely impressive. So, a couple of questions for you:
1. Is there something in your platform resembling the Flexible sync functionality of Atlas? 2. Do you feel that the partner-first approach will open up some space for Ditto? Have you encountered any Atlas Device Sync functionality that would be impossible to replicate for Ditto in terms of integration with MongoDB?
It is great to know that there's a logical successor.
As I mentioned above, I work in a company that offers a SAAS that's based on the Device Sync solution. We were weeks away from announcing a collaboration-oriented product based on Atlas, but now these plans are in shambles.
We are actively looking into Ditto now, and the P2P approach to sync is genuinely impressive. So, a couple of questions for you:
1. Is there something in your platform resembling the Flexible sync functionality of Atlas? 2. Do you feel that the partner-first approach will open up some space for Ditto? Have you encountered any Atlas Device Sync functionality that would be impossible to replicate for Ditto in terms of integration with MongoDB?
Sorry I did not see this reply sooner!
1. Yes Ditto uses query-based sync. Candidly, the flexible sync in Atlas has roots back to when I was VP of Product at Realm. It was a must for me, but I think got abandoned for performance issues then brought back. Ditto was built always to support flexible/query sync. We recently have added our own more advanced query engine - DQL (SQLish) and it will enable JOINs and other advanced queries while still being schemaless JSON collections. In this regard Ditto is a better compliment to Mongo than Realm is from data model perspective.
2. Yes this partner-first approach is huge opportunity for us. Given Realm had to sell, we were very focused on building a sustainable business. This meant though more focus on enterprise and specific use-cases than going wide to all developers (you can see how well that worked with Firebase, Parse, and many other developer products when you have VC backing). This means we have a solid foundation technically (large-scale deployments in mission critical systems) to now handle wider awareness. Mongo will really help us bring the awareness of Ditto.
3. Right now candidly our permission system is nascent compared to Atlas - a webhook fires from Ditto to allow you to integrate into external identity systems and apply permissions. The focus with enterprise meant we targeted use-cases that didn't have too much dynamism in their permissions and data models, so you will find our system naive comparatively. This is a top priority where we will be adding built-in dynamic permission functionality that is similar to Device Sync later this year. You can read more on our system here: https://docs.ditto.live/auth-and-authorization/data-authoriz...
1. Yes Ditto uses query-based sync. Candidly, the flexible sync in Atlas has roots back to when I was VP of Product at Realm. It was a must for me, but I think got abandoned for performance issues then brought back. Ditto was built always to support flexible/query sync. We recently have added our own more advanced query engine - DQL (SQLish) and it will enable JOINs and other advanced queries while still being schemaless JSON collections. In this regard Ditto is a better compliment to Mongo than Realm is from data model perspective.
2. Yes this partner-first approach is huge opportunity for us. Given Realm had to sell, we were very focused on building a sustainable business. This meant though more focus on enterprise and specific use-cases than going wide to all developers (you can see how well that worked with Firebase, Parse, and many other developer products when you have VC backing). This means we have a solid foundation technically (large-scale deployments in mission critical systems) to now handle wider awareness. Mongo will really help us bring the awareness of Ditto.
3. Right now candidly our permission system is nascent compared to Atlas - a webhook fires from Ditto to allow you to integrate into external identity systems and apply permissions. The focus with enterprise meant we targeted use-cases that didn't have too much dynamism in their permissions and data models, so you will find our system naive comparatively. This is a top priority where we will be adding built-in dynamic permission functionality that is similar to Device Sync later this year. You can read more on our system here: https://docs.ditto.live/auth-and-authorization/data-authoriz...
You can also check out ObjectBox (Vivien, CEO of Objectbox here)
Thanks for the reply! Will definitely be looking into Ditto as a migration option. What would you say the main benefits are of going schema-less? In this context does it more mean that the client is responsible for serializing/de-serializing into the correct data structures? I'm browsing the docs already but any extra information would be helpful, particularly around handling evolving data needs, import/export, client sync, etc.
Yeah the client has to serialize/deserialize - think of the DB as a mini Mongo where you insert JSON into collections as the mental model. Reason for this is that in our experience, sync is easier when the system is schema-less because the nature of the system ties folks across teams, so this means the schema tends to live above each individual client (iOS, Android, backend, etc and in larger orgs those are each separate teams). Furthermore, advances such as Codable in Swift and other patterns means client devs are fairly used to handling this with JSON/REST patterns anyway.
More similar is that Ditto uses a query-based sync approach - this was an area I am particularly passionate about and helped push at Realm. The challenge with this vs. strict channels is then scalability of the backend system - but we have solved these scalability challenges in several ways.
Most prominently, internally Ditto works different than at least my understanding of how Realm Sync worked originally (it might have evolved more under Mongo). We use CRDTs to handle the conflict resolution, so any JSON inserted into Ditto, ends up being a nested CRDT structure on disk. This enables the same predictive conflict resolution, but its a crucial trade off compared to other approaches.
First, CRDTs enable P2P sync where no server is needed to mediate the system. This opens up use-cases that Ditto powers where mobile devices sync over Bluetooth and P2P WiFi even without a device accessing the internet. Furthermore, it also opens up more scalability on the backend because the server nodes themselves can communicate P2P.
At a more fundamental level this is a trade off of using extra metadata (CRDTs include more context like version vectors and such to know how to merge with each other) compared to Realm's original approach of Operational Transformation which is an algorithmic approach. We felt that the metadata approach was holistically better because of the access to new use-cases and scalability meanwhile there are clever ways to make the metadata cost not a real-world issue (i.e. compression in various ways). Conversely, the algorithmic approach is limited to a client server architecture and has computational scalability issues.
All in all, we are very sympathetic to transition costs, but are confident folks will find Ditto can meet the same and more capabilities in Device Sync. Our current challenge is going to be introducing a pricing scheme to support the broader set of Mongo users. To date, we have been very focused on larger enterprise deployments (gotta ensure the bills are paid!) so we will be creative to ensure anyone transitioning is not affected by pricing if they like us!
More similar is that Ditto uses a query-based sync approach - this was an area I am particularly passionate about and helped push at Realm. The challenge with this vs. strict channels is then scalability of the backend system - but we have solved these scalability challenges in several ways.
Most prominently, internally Ditto works different than at least my understanding of how Realm Sync worked originally (it might have evolved more under Mongo). We use CRDTs to handle the conflict resolution, so any JSON inserted into Ditto, ends up being a nested CRDT structure on disk. This enables the same predictive conflict resolution, but its a crucial trade off compared to other approaches.
First, CRDTs enable P2P sync where no server is needed to mediate the system. This opens up use-cases that Ditto powers where mobile devices sync over Bluetooth and P2P WiFi even without a device accessing the internet. Furthermore, it also opens up more scalability on the backend because the server nodes themselves can communicate P2P.
At a more fundamental level this is a trade off of using extra metadata (CRDTs include more context like version vectors and such to know how to merge with each other) compared to Realm's original approach of Operational Transformation which is an algorithmic approach. We felt that the metadata approach was holistically better because of the access to new use-cases and scalability meanwhile there are clever ways to make the metadata cost not a real-world issue (i.e. compression in various ways). Conversely, the algorithmic approach is limited to a client server architecture and has computational scalability issues.
All in all, we are very sympathetic to transition costs, but are confident folks will find Ditto can meet the same and more capabilities in Device Sync. Our current challenge is going to be introducing a pricing scheme to support the broader set of Mongo users. To date, we have been very focused on larger enterprise deployments (gotta ensure the bills are paid!) so we will be creative to ensure anyone transitioning is not affected by pricing if they like us!
Got it, this is very interesting and informative. I look forward to learning more about Ditto as I experiment for my migrations away from Realm.