The scaling law only states that more resources yield lower training loss (https://en.wikipedia.org/wiki/Neural_scaling_law). So for an LLM I guess training loss means its ability to predict the next token.
So maybe the real question is: is next token prediction all you need for intelligence?
Non-zero probability I think, one interesting measure of overfitting I've seen is contamination (where the model has seen the exact questions it is being evaluated on) see stats at https://hitz-zentroa.github.io/lm-contamination/
> In 2021 and the first half of 2022 (when most of the 2022 activity happened) we essentially crammed 5 years worth of funding into an 18 month period. Series Bs and Cs were raised when companies were at the typical Series A milestones. Normal round sizes doubled or tripled. Every type of investor was broadly operating in a “risk on” mindset given the ZIRP environment, and the venture capital ecosystem was no exception.
It's useful for streaming data where you want to pass small chunks of data incrementally. JSON by itself isn't streamable (you need the entire blob to decode it). But if we just pass smaller json-encoded chunks of data and separate them with a newline, we can make a streaming-compatible JSON protocol.
Major drawback of Apple Hi Res is that Apple headphones dont support it (bluetooth is lossy), and even their recommended 3.5mm adapter converts it down to 48kHz (https://support.apple.com/en-us/HT212183)
> In venture markets, I think we’re only 10% into the pain that we’ve delayed given the large cash balances of startups. 2025 is probably the year of max pain in the venture ecosystem.
You can export the app artifact and share it. The artifact is human readable and in a JSX format (called Toolscript). In this way it can be meaningfully interpreted, improved and customized by others in an open source manner.
As for running the software the platform has a proprietary license obviously but you can host your own Retool backend from which to serve the apps to your end users (check the docker repo). This is an alternative to the SaaS/cloud based app hosting at https://retool.com/.
There's a free tier to edit and run the apps but professional usage will have a license fee. This is not unlike making an app with VB which required buying VB and having end users buy and run Windows.