Cool work! Something that worries me with PCA is that it's designed to retain variance, but variance might nor be the right metric for the semantics we want to retrieve. Ditto UMAP/tSNE that retains distances in lower dimensionality... If semantics are mostly encoded as directions on subsets of dimensions, PCA and friends would be too blunt of a tool... I wonder if a better approach would be linear probes or other decoders for a wide range of the concepts one wants to retrieve, and then optimize compression while keeping those retrievals as high as possible... i.e. tune the compressor to the usecase, like MP3 or MPEG do.
Armchair comment. I would LOVE to be a grad student again and try to pair it with ultrasound speaker arrays, for medical applications. Essentially a super HIFU (High-Intensity Focused Ultrasound) with live feedback. https://en.wikipedia.org/wiki/Focused_ultrasound
howdy! Clay makers here. Can you share more? Did you try Clay v1 or v0.2
What image size embeddings from what instrument?
We did try to relate OSM tags to Clay embeddings, but it didn't scale well. We did not give up, but we are re-considering ( https://github.com/Clay-foundation/earth-text ). I think SatClip plus OSM is a better approach. or LLM embeddings mapped to Clay embeddings...
You'll need to subscribe to Alexa weather plus, for only 9.99$/month.
Now seriously, yes, hyperlocal short-term weather forecast should be a commodity, even public utility?
Can we help you?
We build the equivalent for land, as a non-profit. It's basically a geo Transformer MAE model (plus DINO, plus matrioska, plus ...), but largest and most trained (35 trillion pixels roughly). Most importantly fully open source and open license. I'd love to help you replace land masks with land embeddings, they should significantly help downscale the local effects (e.g. forest versus city) that afaik most weather forecast simplify with static land cover classes at most. https://github.com/Clay-foundation/model
The Planetary Computer from Microsoft has an explore tool, which includes Sentinel-1 at any time and location, rendered on-the-fly. Free open access. No account required.
I fondly remember how a small DC startup subsubsubcontracted to do the front landing page was able to ensure that at least people landed on healthcare.gov page and not a 500 error page.
All thanks for a single server (with one backup) using Jekyll, if I remember the story correctly.
Down the river, right after DC its the Naval Research Laboratory, in front of Alexandria. I worked there, and some crazy folks from Alexandria sometimes crossed the river in canoes to the NRL pier... That got terminated after 911, so they had to bike or drive all the way up around DC and down through Anacostia Air Force Base. Quite a much longer commute.