valzam

568 karmajoined hace 7 años

comments

hace 12 díasdiscuss

I mean the easiest explanation would be that the model harness doesn't always take the most likely token but does top-k sampling or similar. temperatur just means that probabilities get more and more equalized, boosting the chance that an unlikely token gets picked. but even with temp 0 you could have 0.8 T1, 0.19 T2, ... and sometimes sample T2

hace 15 díasdiscuss

> One of the great drawbacks of "Cloud Native Computing" as it now exists is that it's really, really complicated. It is often more complicated than the old, non-cloud, sort of computing. In order to deploy your app outside of Minerva you now need to know something about k8s, or Cloud Formation, or Terraform.

Highly agree with this. I think it's very underappreciated in startups that if you want people to deploy a lot of small services you have to make that really super easy. I always thought that the value of things like Spark is that you can run "things" without having to worry about how they run. K8s is similar but much more complex. AWS Lambda is nice but also comes with a lot of baggage at scale. I always wanted to try something like Dapr, which seems to provide a very opinionated happy path for application development.

hace 17 díasdiscuss

OP wanted to set up a nested copmany structure. Instead of Person -> LLC it goes Person -> Limited Partnership --> LLC. The in between company is only for tax-efficiency and has nothing to do with limited liability.

hace 29 díasdiscuss

The question is, is that really only due to data center geo? I am always amazed how low latency and high quality Facetime between Europe <-> Australia is. Seems like good engineering can overcome less optimal geographics.

hace 2 mesesdiscuss

Very unrelated: first time I see someone with the same last name as me in the tech community, it's somewhat odd :)

hace 2 mesesdiscuss

Async presumably happens in the JS runtime that bun calls into. Just need 1 thread to host that

hace 3 mesesdiscuss

If this works `git clone [email protected]:me/mine.git release_01 && ln -s release_01 /var/www/me/mine/current` then your Docker builds should also be extremely quick. Where I have seen extremely slow docker builds is with Python services using ML libraries. But those I reallly don't want to be building on the production servers.

"ECS would have worked for 99% of these apps, if they even needed that."

I used to agree with that but is EKS really that much more complicated? Yes you pay for the k8s control plane but you gain tooling that is imho much easier to work with than IaC.

hace 3 mesesdiscuss

I always feel like I am taking crazy pills when I read these threads. The k8s API and manifests config feels like a create standardardized way to deploy containers. I wouldn't want to run a k8s cluster from scratch but EKS has been pretty straightforward to work with. Being able to use kind locally for testing is amazing and k9s is my new favourite infra monitoring tool.

Even if you just run on 2 nodes with k3s it seems worth it to me for the standardized tooling. Yes, it is not a $5 a month setup but frankly if what you host can be served by a single $5 a month VM I don't particularly care about your insights, they are irrelevant in a work context.

hace 3 mesesdiscuss

I don't disagree that very numerical tasks like revenue forecasting are not a good fit for LLMs. But neither did a lot of data scientist concerns themselves with such things (compared to business analysts and the like). Software to achieve this has been commoditized.

hace 3 mesesdiscuss

Do those use cases need LLMs? Probably not. but if good results can be had with a day of prompting (in addition to the stuff mentioned in the article, which you have to do anyway) and a smaller model like Haiku gives good results why would you build a classifer before you have literally millions of customers?

The LLM solution will be much more flexible because prompts can change more easily than training data and input tokens are cheap.

hace 3 mesesdiscuss

As others have mentioned, one big issue is that every company does these things differently and just because someone texts you a link doesn't mean it's phishing, even though it feels shady. In Australia I have had calls by immigration officers on supressed numbers that wanted PII over the phone without being able to tell me what the purpose of the call is.

hace 4 mesesdiscuss

The average person self hosts literally nothing, why would it be different for inference? Which benefits severely from economies of scale and efficient 24/7 utlization

hace 4 mesesdiscuss

Ok but "Business Email" wasn't exactly invented yesterday...

hace 4 mesesdiscuss

I think people are mainly confused because the AirPod Pros are quite competitively priced compared to other higher end offerings. The Max are so far off the market that it doesn't seem to make any sense and it seems unlikely that apple couldn't make up for lost margins with higher volume. Maybe they just literally can't/don't want to produce many of the Max and price them accordingly.

hace 4 mesesdiscuss

Uff, COBOL written in Norwegian, talk about a narrow target to hit for hiring :)

hace 5 mesesdiscuss

I mean it's not like Stripe was founded yesterday. Stripe: 2010 Paypal: 1998

I'd argue that 99% of the "internet gdp" happened after Stripe was founded

hace 5 mesesdiscuss

I mean I know what it means but how can you corpo speak so hard that it's pretty much unclear what the change even is

hace 5 mesesdiscuss

We have an airtag in our cargo bike, connected to our ipad (neither my wife nor I have an Iphone). It never actually makes a sound and we can reliably track on the ipad. what gives? I never thought about this.

hace 6 mesesdiscuss

Except of course rollout will not be atomic anyway and making changes in a single commit might lead Devs to make changes without thinking about backwards compat

hace 7 mesesdiscuss

Do you have a pixel? On Samsung you cannot share WiFi, Hotspot only works with mobile connections. I learners above that this is possible with pixel phones, makes me want to get one...