They want you to buy their hosted service, that's where the convenience is sold. If they give you a one liner script you can paste in or a docker compose that does everything from scratch they cannot sell their hosted services.
I watched this movie recently, and the same thought crossed my mind. I was going to write a blog post about it, but was too afraid to read the responses. I'm glad you did. If I meet you I'd buy you a cup of coffee, we'd talk and we'd become friends.
"When you see that in order to produce, you need to obtain permission from men who produce nothing - When you see that money is flowing to those who deal, not in goods, but in favors - When you see that men get richer by graft and by pull than by work, and your laws don’t protect you against them, but protect them against you - When you see corruption being rewarded and honesty becoming a self-sacrifice - You may know that your society is doomed." ― Ayn Rand, Atlas Shrugged
Thank you for publishing this. I've been following Paul Graham and his works for a long time. It's refreshing to see everything written down in a document like this. This is the bible for startups. Honestly, it's beautifully simple but not easy.
Do you have similar math for the flash-lite variant of the models? I'd be curious. Based on my testing / benchmark i think it's around the 100-120B mark.
With the Pro variant being around 600B - 800B
My testing is comparing it's performance / output to other models in the same size range, so not as scientific as yours.
It's a lot more than an LLM, it's backed by database + LLM. Gemini / ChatGPT on it's own believe it or not has hallucinated movies and imdb links.
While google can show you results it cannot personalize things for you. With this app you can mark movies as seen and you can ask for "things i haven't seen"
or ask it to "pick a movie for me" from a search result, you can tell it which region / streaming service you have and search within things you can actually watch.
You can't do any of that with google.
There are tons of queries i've tried where google will simply not be able to give me good results.
The goal is to have a TvOS app where you can just search across all your streaming options and with a single click open / stream any movies you find. Instead of having to search 10 different streaming apps to something you want to watch.
In the example you provided I could not see any streaming options for any of the movies or figure out if it's available in my region. I would have to do multiple other search to figure out where I can watch them. I also cannot see ratings etc...
I hope that one day humanity learns that in war there are no winners. We're all just brothers and sisters born on different corners of the planet. We share the same home.
I hope that we stop attacking one another and find peace and work together as a race to overcome our challenges.
It's ok, it's not the best. There are models that do better, I'd use it for some basic tasks but not actual complex tasks like query generation and retrieval.
This is going to be a fun one to play with. I've been conducting tests on various models for my agentic workflow.
I was just wishing they would make a new flash-lite model, these things are so fast. Unfortunately 2.5-flash and therefore 2.5-flash-lite failed some of my agentic workflows.
If 3.1-flash-lite can do the job, this solves basically all latency issues for agentic workflows.
I publish my benchmarks here in case anyone is interested:
I never thought of Elasticsearch as a database and always designed systems around what elasticsearch is supposed to be an index based document store for used with search.
I think their API is great and have had amazing results with it. Their recent innovations around quantization (bbq) has been amazing for my use case building an agentic movie database for discovering movies and personalized movie recommendations.
There are benefits to not using your database for everything, even if it adds a bit of complexity by introducing another dependency. If the benefits out weigh the cost of complexity reaching for elastic has almost always been worth it for me.
I see comments like "is this a request to bypass sanctions" OR "he's iranian"
Let's remind ourselves of the following:
- First understand that he didn't choose to be born and raised in Iran.
- Second people grow up have families become attached to where they're born it's not easy to just 'pick up and leave' moving to a new country is expensive and extremely difficult especially from countries like Iran.
- Third he's building something he believes in which is probably better than most people who live in privileged countries who sit around and do nothing.
To me this reads like a plea for help.
He's built something and showing it to the world, if someone likes it and wants to fund him / get him out of Iran, so he can pursue his dreams AND have the people who help him benefit along with him. I'm sure he'll be all for that.