HackerTrans
TopNewTrendsCommentsPastAskShowJobs

elliotto

no profile record

Submissions

Lessons from Implementing RAG in 2025

truestate.io
6 points·by elliotto·8 months ago·1 comments

comments

elliotto
·2 months ago·discuss
Hi, Co2 levels like that are severely high and will cause you to have a lot of issues. I had some issues with poor ventilation and headaches in my apartment, and my solution was to run the bathroom fan all the time - this gave me enough ventilation to feel much better. You're basically suffocating at 3000 ppm.

It's important to measure this somehow - I do this with a $100 Co2 sensor and display I got off amazon, but you seem to already have these sensors available.
elliotto
·5 months ago·discuss
Bravo Garry, net worth $x00m, having the integrity to go after public school teachers.
elliotto
·6 months ago·discuss
This rule does not apply in the main trekking areas that everyone goes to.

In the areas that few people go to, it isn't actually enforced.

The Nepalese government just introduces this rule every few years in response to a missing trekker in the guise of safety.
elliotto
·6 months ago·discuss
I've been to Nepal a bunch of times and I usually recommend just passing quickly through KTM to get to where you are going. The dust can be terrible and it is loud and polluted - the opposite reason to why most people generally want to go to Nepal. Better to spend more time in the mountains or Pokhara
elliotto
·6 months ago·discuss
I worked on a startup experimenting with using gemini-2.0-flash (the year old model) using its full 1m context window to query technical documents. We found it to be extremely successful at needle-in-a-haystack type problems.

As we migrated to newer models (gemini-3.0 and the o4-mini models) we again found it performed even better with x00k tokens. Our system prompt grew to about 20k tokens and the bots were able to handle it perfectly. Our issue became time to first token with large context, rather than the bot quality.

The ultra large 1m+ llama models were reported to be ineffective at >1m context. But at this point, it becomes so cost prohibitive to use anyway.

I am continuing to have success using Cursor's Auto model, and GPT-5.1 with extremely long conversations. I use different chats for different problems moreso for my own compartmentalisation of thoughts, rather than as a necessity for the bot.
elliotto
·6 months ago·discuss
It used to be that the bots had a short context window, and they struggled with getting confused by past context, so it was much better to make a new chat every now and then to keep the thread on track.

The opposite is true now. The context windows are enormous, and the bots are able to stay on task extremely well. They're able to utilize any previous context you've provided as part of the conversation for the new task, which improves their performance.

The new pattern I am using is a master chat that I only ever change if I am doing something entirely different
elliotto
·6 months ago·discuss
Yes, this is AIMD and it's well formalised and understood.
elliotto
·6 months ago·discuss
This is the TCP backoff algorithm, specifically the slow start to find the optimal bandwidth. In your analogy, it would find the optimal amount that a person is willing to reciprocate.

Not only does this algorithm exist, but we're using it to communicate right now!

https://en.wikipedia.org/wiki/TCP_congestion_control
elliotto
·7 months ago·discuss
I wrote this comment in a response to his second chapter, where he presents criticism of the political role of the company as cynical, and then later where he presents a perspective on some tech company anti-union behaviour being conspiratorial.

I definitely took an uncharitable reading, but man am I tired of being told big tech is neutral. I will continue to be cynical and I will continue to gnash my teeth at anyone who tells me otherwise.
elliotto
·7 months ago·discuss
I think there are reasonable things to expect from someone's morality calculus. Leaving the country you were born in for moral reasons is a complex and life changing undertaking and beyond reasonable expectation for anyone not extremely politically motivated, let alone resourced enough to do so. Not working for a company whose moral values you disagree with (when you have an extremely lucrative skillset) is a smaller and more reasonable ask.

I'm also not really asking that people leave these roles - everyone has their own path to take. Just that they don't make posts dismissing criticism of these structures as silly cynicism. Or else they will have to contend with me writing a comment disgreeing with them.
elliotto
·7 months ago·discuss
I don't think he's morally bankrupt. I am disagreeing with his attempt to handwave away a moral analysis of these organizations as 'cynicism'. I think these analyses are really important.

I don't live in the US. But if I did, and I was capable enough to be a successful software engineer, I would try to work for an organisation that was not implicated in abhorrent behaviour. If I was to work for one, I would not attempt to dismiss criticisms of it as cynicism.
elliotto
·7 months ago·discuss
The author seems like a nice guy, but perhaps a bit naive regarding the efforts big tech companies go to to crush employees (https://en.wikipedia.org/wiki/High-Tech_Employee_Antitrust_L...). They appear to be a staff level engineer at a big tech company - I don't know how much money they make, but I suspect it's an ungodly amount.

The organisation he works for is implicated in surveillance, monopoly exploitation, and current military action involving particularly unpopular wars. No one forced him into this role - he could have made less money elsewhere but decided not to. He has decided to be a cog in a larger, poorly functioning machine, and is handsomely rewarded for it. This sacrifice is, for many, a worthwhile trade.

If you don't want to engage with the moral ramifications of your profession, you are generally socially allowed to do so, provided the profession is above board. Unfortunately, you cannot then write a post trying to defend your position, saying that what I do is good, actually, meanwhile cashing your high 6-7 figure check. This is incoherent.

It is financially profitable to be a political actor within a decaying monopolist apparatus, but I don't need to accept that it's also a pathway to a well-lived life.
elliotto
·7 months ago·discuss
The author postulates a few ideas about manners and courtesy, and starts to recognise that business transactions (employment relationships) don't actually care about these things, even though the human beings who populate these systems hold these values.

The nash equilibrium in a buyer-seller market like the employer-employee relationship is for both sides to defect. Humans don't behave optimally, because they aren't pure rational creatures, they are imbued with some socialisation and cultural memory. So humans try to treat with these organisations as though they are other humans, and will respond to good-will with good-will, but this is not rewarded, and ultimately they change their behaviour in response to a poor environment.

Capital does behave short term optimally. Optimal economic behaviour is to betray the person opposite you, and violate and exploit the commons until the commons collapses entirely, like what we see today. At some points in the past, capital has been subdued by a human operator who will apply courtesy and social norms to prevent these ugly actions, but capital has now become too intelligent to bother with this, and the result is a sequence of increasingly insane and inhuman processes, such as what we see here with the job market.
elliotto
·7 months ago·discuss
Many countries have financial incentives provided to its citizens to have children. Requiring half of a citizens median salary to be given to a faceless middleman to provide this service seems untenable. I cannot imagine a society that does this would be able to survive.
elliotto
·8 months ago·discuss
This is a good article that is critical of narratives around behaviour within organisations. I particularly enjoyed his criticism of the 'morality tale'.

The author then postulates some guidance for how to survive in organisations more generally, working above these strange social structures largely unique to silicon valley. It wasn't the purpose of the article, but I wish he was a bit more critical of these structures in general.
elliotto
·8 months ago·discuss
Under this definition, could any tool at all be considered to produce more value?
elliotto
·8 months ago·discuss
I completely agree with this.

I think the writing style the LLM produces is an artistic decision made by committee prioritizing for inoffensiveness - what a coincidence that it comes out sounding like LinkedIn slop.

I don't really see any innate reason an LLM couldn't write well - it's an active decision by its creators to tell it not to.
elliotto
·8 months ago·discuss
[flagged]
elliotto
·8 months ago·discuss
I don't quite understand this post. Wouldn't rolling out fiber infrastructure early have been proved to be visionary and made the UK a serious technical force?

In Australia, we went through a similar journey where fiber to everyone's home was planned and then politically destroyed. Except this happened in 2010 and has been a significant factor in our inability to retain a technical edge.
elliotto
·8 months ago·discuss
Beats giving all the money to the person who says the word 'blockchain' the most.