ahamilton454

22 giorni fadiscuss

Throwing a tiny little LLM at it helped me assess that it was far too slow for me to reasonably use at the scale I needed. So it didn’t really matter how accurate the prompt was. I was more just pointing out that I didn’t know if would be too slow without trying it. I maybe could have done some simple math in retrospect, but trying it out was easy enough

ahamilton454

22 giorni fadiscuss

Yeah, Ive tried a bi-encoder, cross encoder and some small LLMs so far. I think I’ll do BERT soon too

ahamilton454

22 giorni fadiscuss

Yeah exactly, I literally don’t know how to change my spec until I’ve gathered more data.

I was building a transaction classifier recently and I initially thought it would be a trivial “solved” problem. Throw transactions into a tiny local LLM, let it classify. But that approach was too slow, and not accurate enough. I didn’t know that though until I tried and then needed to change the spec.

ahamilton454

22 giorni fadiscuss

I like that you point out that the cost to build software is still not 0. And in my expirence it’s further from 0 than I would expect. I often find myself thinking I can rebuild a project (or usually improve upon an existing one) in just a few days. And yet when it comes down to making anything well, it still takes time and iteration.

It’s a bit funny because I felt this way before coding agents as well, like you could clone something in just a few weeks. But in practice my expectations are rarely accurate.

ahamilton454

7 mesi fadiscuss

Reading this on my eink Bigme Hibreak pro :).

ahamilton454

8 mesi fadiscuss

I use the bigme hibreak pro as my primary device. Its an eink device but also just a full phone. Almost bought the boox palma, but held back because I only really want to carry a single device.

comments