HackerTrans
TopNewTrendsCommentsPastAskShowJobs

krohling

no profile record

Submissions

BLT Deep Dive: Hello bytes, goodbye tokens

medium.com
1 points·by krohling·2 ปีที่แล้ว·0 comments

comments

krohling
·ปีที่แล้ว·discuss
I think this is a creative approach. I wonder how the success rates for that little RNN compare to the success rates of the primary LLM, especially for complex queries or complex tool calls. At some point you have to scale that network up large enough to get better results. Eventually you've come back around and you might as well use an LLM. I think a similar approach with potentially better results (depends on the application) could be accomplished by using that same dataset to finetune a small language model. It'd be interesting to see some success rate comparisons.
krohling
·ปีที่แล้ว·discuss
Is it realistic to think that the poors will start their own economy servicing each other? I'm sure there would be chaos and violence for a period but eventually it seems like the path upward would be a whole new economic system for that 98%. This system could even make use of the automation offered by AI.
krohling
·2 ปีที่แล้ว·discuss
Do something to help everyone else stuck in the system. Hire lobbyists to improve healthcare in the US. All the other rich people are just trying to make things worse and extract as much as possible.
krohling
·2 ปีที่แล้ว·discuss
This is awesome! Congrats. Clearly a lot of work and a very cool library.
krohling
·2 ปีที่แล้ว·discuss
"Our AI agent finds precisely what you ask for, 10-50x better than Google Scholar"

I was curious how this was measured since benchmarking accuracy for LLMs is tough. Found this in the paper: "This classification accuracy was benchmarked by manually analyzing over 400 papers across a range of representative searches, and comparing the human evaluation to the language model’s judgment"

I'm skeptical that their dataset of 400 papers with 3 classification labels (highly relevant, closely related, or ignorable) is large enough to represent the diversity of queries they're going to get from users. To be clear, I don't think this undermine's (haha) the value of what they've built, still very cool.
krohling
·3 ปีที่แล้ว·discuss
"We are told that technology takes our jobs, reduces our wages, increases inequality, threatens our health, ruins the environment, degrades our society, corrupts our children, impairs our humanity, threatens our future, and is ever on the verge of ruining everything."

Ok, fair enough. I wouldn't pin any of these issues on "technology". I lay them at the feet of "businesses" specifically operating within a capitalist landscape. Unfortunately "technology" is tightly coupled to "businesses" in the Western world and I don't think that removing constraints on the latter will benefit anyone except, you know... rich people.

"We believe the techno-capital machine of markets and innovation never ends, but instead spirals continuously upward. Comparative advantage increases specialization and trade. Prices fall, freeing up purchasing power, creating demand. Falling prices benefit everyone who buys goods and services, which is to say everyone. Human wants and needs are endless, and entrepreneurs continuously create new goods and services to satisfy those wants and needs, deploying unlimited numbers of people and machines in the process."

Calls for further doubling down on Capitalism given the dire inequality and our inability to meet even basic needs for so many people in our already rich society strikes me as the utmost expression of societal tone deaf.