Hi, one of the authors here! Thanks for your question – you raise a good point about inference and model size.
We touch a bit on potential applications in section 8 of the report ("Future directions"). One of our main focuses is on autonomous troubleshooting agents that can query and reason about metrics. In this context, the size and cost of Toto is considerably smaller than that of LLMs already in use for similar workflows. In future work, we envision using Toto in a multimodal context where expect the time series backbone to represent a manageable proportion of the overall compute budget.
We are also exploring how to use Toto to improve our anomaly detection and proactive alerting solutions at scale, and you're right that more work remains there in terms of inference efficiency.
This is a very useful guide. I'd add one additional step that can sometimes be useful if you're doing a more complex change than adding a field to an object. For example, sometimes you may want to read from an entirely new schema or data source, while ensuring that the user-facing behavior stays the same.
In that case, you'd want to add a step between steps 2 and 3 where you double-read, either inline or within a shadow workload, and add telemetry to alert you if there are discrepancies between the two versions.
Only when you're confident that the two data models are producing acceptably equivalent results would you cut over the primary reads to the new model.
This pattern often comes to play when you break off a piece of state from a monolithic database into a dedicated service.
This is actually referring to different species of grapes, and has nothing to do with winemaking technique or prowess.
Virtually every type of "quality wine" that is consumed in the world comes from the old world species vitis vinifera. This includes basically every variety you've heard of: Chardonnay, Cabernet Sauvignon, Pinot Noir, Syrah, Merlot, just to name a few French varieties (but the same applies to Italian, Spanish, German, etc. wines). Any American winemakers making those kinds of wines (and I agree that many New World wines go toe-to-toe with the best France has to offer!) are using grape vines that were originally imported from Europe.
In addition, there are several species of grapes that are native to North America, the best known of which is probably the Concord grape. Unfortunately, due to their flavor profiles these species don't tend to be used for winemaking (one exception being Manischewitz and other sweet ritual wines). However, they have a natural resistance to phylloxera, which saved vitis vinifera from decimation and likely extinction through the grafting technique.
We touch a bit on potential applications in section 8 of the report ("Future directions"). One of our main focuses is on autonomous troubleshooting agents that can query and reason about metrics. In this context, the size and cost of Toto is considerably smaller than that of LLMs already in use for similar workflows. In future work, we envision using Toto in a multimodal context where expect the time series backbone to represent a manageable proportion of the overall compute budget.
We are also exploring how to use Toto to improve our anomaly detection and proactive alerting solutions at scale, and you're right that more work remains there in terms of inference efficiency.