gravypod · HackerTrans

قبل 15 ساعةdiscuss

There was an article posted on HN recently about the asymmetry in cost of providing an ambulance service vs the cost of the per-ride service. The cost of a medical degree, and the training on top of the degrees, may seem waaay too high but I am sure that when you need the service you want it to be there. I think if I break a leg, need an emergency surgery, etc I will be okay with $0.00001 of my taxes going into the pile needed for paying off those $500k loans.

gravypod

قبل 6 أيامdiscuss

Medicine and jokes

gravypod

قبل 8 أيامdiscuss

I assume that the reMarkable here would mainly just be used to capture the writing. It could then be examined by an LLM asynchronously.

gravypod

قبل 9 أيامdiscuss

I inherited a large (to me) collection of books from the USSR from my grandfather who immigrated here. Do you know how someone could find a collector or something who would appreciate them? I'm not looking to make money here, I just don't want the books to stay on the shelf of someone who will never read or appreciate them.

gravypod

قبل 17 يومًاdiscuss

Since you know the size of the file beforehand you may be able to overfit some kind of text diffusion model instead of a transformer? May allow you to partially correct the model output using some other method and then fill in the blanks that were wrong from previous generations.

gravypod

قبل 19 يومًاdiscuss

I wonder how close OpenAI is getting to using the memory they purchased. Are they planning to stack a huge amount of HBM2 into these chips?

gravypod

قبل 20 يومًاdiscuss

I would happily buy this and drive it if the US government let us.

gravypod

قبل 25 يومًاdiscuss

How does this work with GitHub?

gravypod

قبل 25 يومًاdiscuss

Is this true? I think SROs were very common in the US in metropolitan areas.

It was common plot point in media to: 1) kick your kids out at 18, 2) if two men lived together they were assumed to be dating.

gravypod

قبل 25 يومًاdiscuss

In 1970 a $300/month apartment would be ~$2000/month in today dollars. I do think rents are too high as productivity and supply chains are much more efficient. I think in the 70s we were still using black pipe for gas, iron septic lines, and copper pipes for water. But, I don't think new builds or renovations are cheaper inflation adjusted (harder to estimate).

Cost of money (inflation), building, and maintenance is the floor for rents.

gravypod

قبل 28 يومًاdiscuss

What kind of systems do you work on? Does it have production traffic? Is there a cost to downtime?

gravypod

الشهر الماضيdiscuss

Having slower memory may not actually lead to lower memory bandwidth. The cuda cores can be broken up into compute complexes which larger blocks of memory directly attached to the cores. These could be filled with read operations from the bulk system memory. You can start executing and then page the next batch of data in while compute is working. For LLMs you don't have much random memory access, you can sequence your accesses in blocks.

If these chips become popular I am sure you will see LLM architectures taking advantage of the parallelism.

gravypod

الشهر الماضيdiscuss

I've known a few college graduates who have come up in this market. From what I see, the common pattern is to try and get a position in your field for 3-10 months. Somewhere in that time range, they burn out. Then they apply for something field related for a few months. Then anything. Once they've exhausted all options they usually give up.

We will likely have a similar concept in our country as China's "lying flat" movement unless we make a big shift.

gravypod

الشهر الماضيdiscuss

What is more important than core count is how the caching architecture is laid out. They could lay out those 6k cuda cores in a layout which provides much larger blocks of cache to smaller number of cores. That would increase the memory bandwidth which would be better for inference.

gravypod

الشهر الماضيdiscuss

Owning and using guns doesn't cause cognitive decline in the same way I've observed steep cognitive changes in people I know who are taken in by LLMs.

I recently had a friend ask an LLM what fun things there are to do in a town we were visiting. It gave the most generic answer like "try local restaurants" and "there are bars" and stuff. There's not a lot of tourist information for this area so it was nonspecific.

This is someone with an advanced degree in a medical field and she thought this was amazing insight. I asked, how is this different from what you already knew and she stood there thinking for a bit and you could tell there was a cognitive dissonance uncovered. She was very concerned when thinking it over and realizing it wasn't something she was able to intuit.

A relative of mine a long time ago had a stroke and recovered. I hadn't seen that facial expression since trying to help my relative figure out how to sit in a chair again.

Basic cognitive functions lost easily, difficult to rebuild.

gravypod

الشهر الماضيdiscuss

I fear what's going to happen with less tech literate managers who don't understand these cases.

gravypod

الشهر الماضيdiscuss

> Also the amount of commits is suspicious. In the last two months, rsync had about as much commits as in the last two years before that.

I wonder if the data looks worse or better when not doing per-10commit and instead do per-commit.

gravypod

الشهر الماضيdiscuss

This is a really cool post but I think one metric we may want to also look at is does using agentic coding tools in one domain impact your coding abilities in another domain? A lot of people I know have been talking about getting rusty on the fundamentals recently. This is not something I am particularly feeling as I do a mix of running agents in parallel and writing some code manually where it makes sense. But if people who have been prompt-only at work come home and work on rsync and are more "rusty" maybe that could also lead to more bugs?

This would be even harder to measure.

gravypod

الشهر الماضيdiscuss

> CI/CD?

That is less useful when the changes are editing the tests but we don't know if a human has validated the assertions.

> My non-techie friends send me screenshots of ChatGPT. I guess that’s a modern micro aggression?

I think the concern I have is explicitly not the sending the chat logs. I think it's this flow:

1. Ask a question

2. Get an answer from a team member.

3. I don't like the answer and instead of discussing I am going to go to Claude and ask the same question.

4. Copy/paste the answer into chat without seeing if it includes novel information.

In one case the engineer was asking which model to select in the agent framework we are using. I gave an answer and provided a list of reasons. They did not like this answer and asked Claude which gave the same answer.

The answer was something inherently obvious and that anyone should be able to derive from first principals.

gravypod

الشهر الماضيdiscuss

I did read the other replies. I don't think my comment is that LLMs are bad. I use LLMs and agents for work. I think my "oh shit" moment is the dynamic that giving someone LLMs amplifies their impact (positive or negative).

For example, some people give kids tiny go karts and that's acceptable because the damage they can do with a very tiny battery powered 4 wheeler is minimal. We now live in a world where everyone has access to a tank and can plow over everything.

I think LLMs will increase anti-social behavior.

comments