100%. I'm not really sure why we all agreed that deployment is somehow the hardest thing that you need to outsource when setting the linux server is one the richest experience you can get and it will pay dividents forever.
Author here. I understand that you need to prompt in a way that is similar to training set.
It makes sense but it's still weird that your instructions to the machine needs to sound like talking to human. This is just side effect of how is the machine trained and constructed.
> Pre-training is, actually, our collective gift that allows many individuals to do things they could otherwise never do, like if we are now linked in a collective mind, in a certain way.
The question is if you can have it all? Can you get faster results and still be growing your skills. Can we 10x the collective mind knowledge with use of AI or we need to spend a lot of time learning the old wayTM to move the industry forward.
Also nobody needs to justify what tools they are using. If there is a pressure to justify them, we are doing something wrong.
I missed last train due to delays and there was a group of in the same situation. One nice person offered me to that I can sleep on their couch. And they were so nice to give me a ride to the station the next day.
I was so angry at first when I found out that this was my last train and I missed it but it turned out to be great story I can tell :)
Thank you strangers, I'll repay it back to somebody in the future
I'm betting against wasm and going with containers instead.
I have warm pool of lightweight containers that can be reused between runs. And that's the crucial detail that makes or breaks it. The good news is that you can lock it down with seccomp while still allowing normal execution. This will give you 10-30ms starts with pre-compiled python packages inside container. Cold start is as fast as spinning new container 200-ish ms. If you run this setup close to your data, you can get fast access to your files which is huge for data related tasks.
But this is not suitable for type of deployment Cloudflare is doing. The question is whether you even want that global availability because you will trade it for performance. At the end of the day, they are trying to reuse their isolates infra which is very smart and opens doors to other wasm-based deployments.
I would add that doing things on your own, which is probably never optimal from time perspective, may open doors to solutions that you haven't seen before.
I recently experienced this is by not going through the beaten path - installing well-known dependencies and building solution based on that. I chose to experiment a bit and it turned out that I usually use small % of imported code.
You can go very far with just node alone (accepts typescript without tsc, has testing framework,...). Include pg library that has no dependencies. Build a thin layer above node and you can have pretty stable setup. I got burnt so many times that I think it is simply impossible to build something that won't break within 3 months if you start including batteries.
When it comes to frontend, well I don't have answers yet.
Socials: - github.com/rybarix - x.com/sandrorybarik
Interests: AI/ML, Web Development
---