Definitely put your finger on what I’ve been feeling.
> What AI did was give every engineer a small team of tireless, fast, occasionally-wrong direct reports. And with the team came the manager’s problem. The discomfort engineers are feeling right now isn’t an AI problem. It’s a delegation problem, and delegation is the oldest unsolved problem in our discipline.
I’ve been using MixedBread, which is a pretty old model at this point. Recently, I tried comparing it to some newer models and was disappointed that the results weren’t dramatically and uniformly better.
You probably can’t go wrong if you pick a recent one that scores decently well on benchmarks and is at the right price point (or memory requirement) for whatever you’re trying to do.
Thanks for that! I added the first one to the feedback board here https://feedback.scour.ing/142 and I'm tweaking the recommendations to avoid topics like Swedish filesystems.
Pick an embedding model that supports binary quantization and then use a SIMD-optimized Hamming Distance function. I'm doing this for Scour and doing about 1.6 billion comparisons per second.
Reading your website and the investor deck, one of my main questions was "who is behind this (and is this just AI-generated)?" It would be useful to put more of a bio on there.
Not having macOS/Windows support is going to make it hard to develop with. Would it be possible to build some kind of shim on top of other libraries that mirrors the API, even if it doesn't match the performance?
Also, one of the advantages of using a popular HTTP server stack is getting lots of battle-tested middleware that other people have developed and tested. Is there any way to leverage any of that or do you need to build everything from scratch? Granted, that is certainly somewhat easier in the AI era, but still.
I believe so. When you call `raw_sql`, the API doesn't provide a way for you to specify which parts of the query are parameters, so it just passes that exact string in to exec.
You specify your interests as free form text, it ranks articles by how closely they match, and you can consume your Scour feed as an RSS feed to read it in NNW.
> In Deno Sandbox, secrets never enter the environment. Code sees only a placeholder
> The real key materializes only when the sandbox makes an outbound request to an approved host. If prompt-injected code tries to exfiltrate that placeholder to evil.com? Useless.
I know the purpose of these pieces is to drive interest in companies that Amplify has invested in, but I appreciate the technical depth they do it with.
> What AI did was give every engineer a small team of tireless, fast, occasionally-wrong direct reports. And with the team came the manager’s problem. The discomfort engineers are feeling right now isn’t an AI problem. It’s a delegation problem, and delegation is the oldest unsolved problem in our discipline.
Very good synthesis.