HackerTrans
TopNewTrendsCommentsPastAskShowJobs

captainkrtek

no profile record

Submissions

Taming the Unpredictable: Reliability in Chaos (Srecon 26)

usenix.org
1 points·by captainkrtek·2개월 전·0 comments

Ask HN: How do you review gen-AI created code?

8 points·by captainkrtek·4개월 전·9 comments

comments

captainkrtek
·2개월 전·discuss
Amen to this.

I've bounced back and forth on my feelings for AI and have landed in the realm of: - there are certain things it is exceptional at that humans cannot replicate. - there are certain things I do not want to use it for.

And review falls squarely in that first category. Similarly, it is exceptional at working through "low hanging fruit" type problems such as spotting inefficiencies, analyzing a profile to find flaws in software, etc.
captainkrtek
·3개월 전·discuss
Do any of the major streaming platforms have a stance against AI generated music?
captainkrtek
·3개월 전·discuss
I use Claude Opus 4.6 as an enterprise user, and have also noticed a lobotomization. In recent weeks it's been much more self-correcting even within singular responses ("This is the problem - no wait, we already proved it can't be this - but actually ...") I'm wary of 4.7 being a change in this pattern, it's frustrating to have such a substantial change in experience every few months.
captainkrtek
·4개월 전·discuss
Was talking about this with some colleagues who are from Ukraine, Russia, and other countries.

In the US, it seems corruption is only allowed at the top. If you tried to bribe your way out of a traffic ticket as a regular person, you'd get in big trouble, then meanwhile the president pardons wealthy fraudsters [1].

Meanwhile, in countries like Russia, everyone can get in on the action. A colleague of mine told me if he were to get drafted to the war, he knew exactly how much to pay and who to pay off locally to get his name off the list. It's equal opportunity corruption.

[1] - https://techcrunch.com/2025/03/28/nikola-founder-trevor-milt...
captainkrtek
·4개월 전·discuss
On my team I've been adding additional linters and analyzers (some I've written with Claude) to run at CI or locally to prevent codified "bad patterns" from entering our systems. This has been nice as a backstop, as I can't enforce what everyone's Claude prompts and local workflows are, but we can agree what CI checks run before merging. Not a 100% solution, but it has been helpful so far.
captainkrtek
·4개월 전·discuss
I've been toying with this too.

I added a Claude skill (/gather-history) that consolidates the history of our session(s) specific to the change into a series of: decision log, involvement (how much did I write vs. AI, how many refinement iterations, reviews, etc.) that I can then include in the PR. So far this has been helpful for my colleagues to understand how I arrived at the change and how thoroughly it's been developed.
captainkrtek
·4개월 전·discuss
There seems to be so much value in planning, but in my organization, there is no artifact of the plan aside from the code produced and whatever PR description of the change summary exists. It makes it incredibly difficult to assess the change in isolation of its' plan/process.

The idea that Claude/Cursor are the new high level programming language for us to work in introduces the problem that we're not actually committing code in this "natural language", we're committing the "compiled" output of our prompting. Which leaves us reviewing the "compiled code" without seeing the inputs (eg: the plan, prompt history, rules, etc.)
captainkrtek
·4개월 전·discuss
One challenge with code review as an antidote to poor quality gen-AI code, is that we largely see only the code itself, not the process or inputs.

In the pre-gen-AI days, if an engineer put up a PR, it implied (somewhat) they wrote their code, reviewed it implicitly as they wrote it, and made choices (ie: why is this the best approach).

If Claude is just the new high level programming language, in terms of prompting in natural language, the challenge is that we're not reviewing the natural language, we're reviewing the machine code without knowing what the inputs were. I'm not sure of a solution to this, but something along the lines of knowing the history of the prompting that ultimately led to the PR, the time/tokens involved, etc. may inform the "quality" or "effort" spent in producing the PR. A one-shotted feature vs. a multi-iteration feature may produce the same lines of code and general shape, but one is likely to be higher "quality" in terms of minimal defects.

Along the same lines, when I review some gen-AI produced PR, it feels like I'm reading assembly and having to reverse how we got here. It may be code that runs and is perfectly fine, but I can't tell what the higher level inputs were that produced it, and if they were sufficient.
captainkrtek
·6개월 전·discuss
Will there be an interest in vision based wearables?

Google Glasses - dead

Apple Vision Pro - dead

FB/Meta x RayBan - dead soon(?)

It seems they can’t get over the social hurdle of having a camera strapped to your face, and the effects of that on people around you. I think the tech is neat, but not socially accepted as a concept to make it viable. My sister is big into tiktok and filming all the time, and it personally makes me hesitant to be nearby as I’m not comfortable being filmed all the time.
captainkrtek
·6개월 전·discuss
50+ weeks? so a year?

I've been in big tech for 12+ years now. The first handful of years are definitely a grind to earn your spot, get a couple promos. After that though, it can become quite a bit easier to coast if that's what you're looking for. People know you, know you're probably valuable cause you're "senior" or "staff" and still here, and likely leave you alone. But yeah, as a newer engineer these days, it still requires the initial commitment to earn the privilege of coasting in a big tech company.
captainkrtek
·6개월 전·discuss
My biggest problem with usage of an LLM in coding is that it removes engineers from understanding the true implementation of a system.

Over the years, I learned that a lot of one's value as an engineer can come from knowing how things actually work. I've been in many meetings with very senior engineers postulating how something works arguing back and forth, when quietly one engineer taps away on their laptop, then spins it around to say "no, this is the code here, this is how it actually works".
captainkrtek
·6개월 전·discuss
Agreed, seen a number of short form news pieces / docs on the effects of datacenter development across different parts of America. Pollution, noise, lights, water impacts, energy costs, etc. not a lot to like from them, and they create very few jobs in relation to the community.
captainkrtek
·7개월 전·discuss
I'm no economist, but if (when?) the AI bubble bursts and demand collapses at the price point memory and other related components are at, wouldn't price recover?

not trying to argue, just curious.
captainkrtek
·7개월 전·discuss
As a customer of GitHub actions, anecdotally feels like Github experiences issues frequently enough to make this not a problem.
captainkrtek
·7개월 전·discuss
I've lived in Seattle my whole life, and have worked in tech for 12+ years now as a SWE.

I think the SEA and SF tech scenes are hard to differentiate perfectly in a HN comment. However, I think any "Seattle hates AI" has to do more with the incessant pushing of AI into all the tech spaces.

It's being claimed as the next major evolution of computing, while also being cited as reasons for layoffs. Sounds like a positive for some (rich people) and a negative for many other people.

It's being forced into new features of existing products, while adoption of said features is low. This feels like cult-like behavior where you must be in favor of AI in your products, or else you're considered a luddite.

I think the confusing thing to me is that things which are successful don't typically need to be touted so aggressively. I'm on the younger side and generally positive to developments in tech, but the spending and the CEO group-think around "AI all the things" doesn't sit well as being aligned with a naturally successful development. Also, maybe I'm just burned out on ads in podcasts for "is your workforce using Agentic AI to optimize ..."
captainkrtek
·7개월 전·discuss
I think the obvious things are:

- Deviation in consistency/texture/color/etc.

- Obvious signs related to the above (eg: diarrhea, dehydration, blood in stool).

Ultimately though, you can get the same results by just looking down yourself and being curious if things look off...

tldr: this feels like literal internet-of-shit IoT stuff.
captainkrtek
·7개월 전·discuss
Do you think they're using the guise of "its solar radiation" as cover to do a software update to fix a more problematic "bug", and perhaps tangentially there are some changes in said-update to improve some error correcting type code (eg: related to detecting spurious bit flips).
captainkrtek
·7개월 전·discuss
This has not been my experience at least at the more remote-friendly places I worked. However, I can see this at companies with different culture / pace / attitude.

My most recent role the entire company of ~200 was remote, and so there was rarely the expectation of immediacy in a response. If something was truly urgent you'd be paged.
captainkrtek
·7개월 전·discuss
This is excellent and aligns with my own experience.

During my day I try to minimize interruptions by batching them. I will largely ignore Slack, and as notifications come in I glance and determine quickly if it really is urgent or if it can wait. If it can wait, I will punt all of those messages to a "remind me later" of a few hours, and get back to my task. I think this keeps my "recovery time" small as I'm not looking too close at these messages. It's not perfect, but definitely helps over pausing my "real work" to fully dive into each notification or ask.
captainkrtek
·7개월 전·discuss
No no, we just need to put even more money in.