HackerTrans
TopNewTrendsCommentsPastAskShowJobs

johmathe

no profile record

Submissions

Guide to Machine Learning with Geometric, Topological, and Algebraic Structures

arxiv.org
176 points·by johmathe·vor 2 Jahren·27 comments

Show HN: Live AI based global weather forecast

earth.atmo.ai
12 points·by johmathe·vor 3 Jahren·2 comments

End-to-end deep learning methods beat production weather forecast accuracy

arxiv.org
3 points·by johmathe·vor 4 Jahren·1 comments

300 meters resolution SF Bay Area Forecast

sf.atmo.ai
169 points·by johmathe·vor 4 Jahren·115 comments

comments

johmathe
·vor 2 Jahren·discuss
Thanks for the great pointers!
johmathe
·vor 2 Jahren·discuss
One of the authors here. Thanks for your comment! While a lot of this research is theoretical and does not have immediate use cases, we have tried to summarize some of them in the last paragraph of the paper (VII. Applications of Non-Euclidean Geometry). See page 26. We present some in Chemistry and Drug Development, Structural Biology and Protein Engineering, Computer Vision, Biomedical Imaging, Recommender Systems and Social Networks and Physics.
johmathe
·vor 3 Jahren·discuss
Thanks for the feedback! This model will evolve over time, we are planning on pushing a much higher resolution soon. Skill wise we will publish a paper in the next few months.
johmathe
·vor 4 Jahren·discuss
The model is currently ran every day. Hope you were able to use it for this weekend :)
johmathe
·vor 4 Jahren·discuss
We are currently integrating with Forecast Watch a 3rd party that analyses and compare various forecasting systems [1]. Please stay tuned until we integrate our APIs. I will be updating this thread when it is ready.

[1] https://www.forecastwatch.com/
johmathe
·vor 4 Jahren·discuss
We will be adding the Celsius switch shortly. We started with F since we expected most users of the forecast to be in the bay area but it is great to see interest from non Fahrenheit users :)
johmathe
·vor 4 Jahren·discuss
It will come within the next few days - please stay tuned. Being from Europe I am more used to Celsius myself :)
johmathe
·vor 4 Jahren·discuss
Thanks for the feedback :) The highest resolution models you can currently find on windy is around 3x3 km (HRRR) and this resolution is unfortunately too big to capture fine terrain and water features. 300x300 gives you 100 times more data points to work with.
johmathe
·vor 4 Jahren·discuss
While a good set of initial conditions is indeed critical, having a smaller model is helpful for modeling micro climates such as the ones you see in the Bay Area. At this resolution you can have a much more detailed representation of relief and water, which are two of the biggest drivers behind the beautiful dynamics we observe here.

Kalman filtering is only one part of the process, and plays a critical role during the data assimilation part. Classical Kalman filtering is optimal for Gaussian-distributed linear dynamical systems, but needs tweaks for non Gaussian distributions and non linear systems.

Classical NWP models for instance will integrate the primitive partial differential equations in time and space and run various parameterizations (which can be in some cases even more expensive than integrating the primitive equations). ECMWF on their end use IFS, which is a spectral method for solving the PDEs.

The whole process of solving these models accurately has definitely been some of the most fascinating science and engineering I’ve had the pleasure to work with. It’s extremely humbling :)
johmathe
·vor 4 Jahren·discuss
Very valuable feedback - thank you!
johmathe
·vor 4 Jahren·discuss
One of the interesting things the model captures at this resolution is the dynamics of the wind going in the bay through the golden gate. See for instance: https://sf.atmo.ai/[email protected],-122.44543,11.68,36,0,16669...
johmathe
·vor 4 Jahren·discuss
All fixed up and deployed.
johmathe
·vor 4 Jahren·discuss
It means that the underlying weather data is computed and validated at a 300x300 meters resolution. Hope this helps :)
johmathe
·vor 4 Jahren·discuss
Thanks for the feedback. We will have the back button fixed quickly :)
johmathe
·vor 4 Jahren·discuss
It’s a forecast of the best spots to have a picnic in the bay :) Basically a proxy for the best place and time to be outdoors.