This drives me crazy when dealing with various contractors in my area. They often only answer by text, and can take a little while to do so. Not a big deal.
But If I send a message with more than one question, there is what feels like a 10% change they will answer all my questions and a 90% chance they will either answer one or none and I’ll just get an “ok”. And I am talking about 5 lines messages not 50 lines.
So I have to send my questions one at a time, wait sometimes minutes to hours for an answer, then send the next one.
Of course I can also call, but often can’t reach them. Or can reach the front desk that doesn’t have the answers. I understand people are busy but it turns something that should be one message into a cat and mouse game
From looking at how that was done, it seems they (the paper you linked) used an older paper which looked at which names are frequent enough and more biased toward a certain demographic (90% of that name occurrence falls within that demographic).
But they picked 9 family names per group. Which sounds quite low. And combined that with first names to reach 500 first+last names per group.
I wonder how much of the bias we see has to do with the names actually picked versus it being racially motivated (absolutely not denying that this probably is a factor, but might not be the only one).
For example, in France there is the national BAC end of high school exam. If you you at the names X grade distribution, and look at the higher “very good” bracket: some names are heavily under-represented (less than 5% of say “Jordan” get that grade) while some are over-represented (35% of “Josephine” get such a grade). The exam is for the most part anonymous, but some names are definitely heavily correlated with lower/higher income groups. So nothing surprising: Josephines tend to come from richer families, thus in average get better education/support, thus better grades. Same thing is true with family names to a smaller extent.
So I wonder how much of the bias we see, be it from real persons or the AI has more to do with a class thing than a racial thing. Again those are not neatly separate things, but still
Yes possible. But really that video of them features the word prominently (even on the thumbnail) AND that vocabulary estimation website. The video/podcast is just slightly over a week old.
Anyway doesn’t really matter, it was more to see if anyone else was a listener of that podcast.
Not sure how to understand that. You mean as the best engineers?
Funnily at my company, the few engineer that did the majority of the work before AI still do the majority of the work now. By majority I mean tackling both more issues and better.
However there is a general verboseness and over engineering trend across the board.
I have a similar issue. I tend to have a very “structured” type of writing. Say on slack or Reddit for example. Using markdown formatting. Lists with bulletpoints etc. And I tend to write long detailed explanations, sometimes too long if I am being honest.
But now I find myself adding noise and imperfections to my writing (not that it was perfect) to make it more human, which is kinda silly.
I still love learning, especially outside of tech. Been working in the ML field for over 8 years, and while I went into it because I liked the field, I did lose some interest in learning things, but mostly because of the sheer volume of publication and the rate of change. Learning stopped being something I enjoyed doing and went to something I had to do to keep up. And it just stopped having the same flavor.
I also like meaningful commit names. But am sometimes guilty of “hope this works now” commits, but they always follow a first fix that it turns out didn’t cut it.
I work on a lot of 2D system, and the only way to debug is often to plot 1000s of results and visually check it behaves as expected. Sometimes I will fix an issue, look at the results, and it seems resolved (was present is say 100 cases) only to realize that actually there are still 5 cases where it is still present. Sure I could amend the last commit, but I actually keep it as a trace of “careful this first version mostly did the job but actually not quite”
I mean “mistakes” can be hard to define. IMHO there is an area of responsibility between the LLM, the LLM user, and the code itself.
Did it make a mistake because I didn’t follow instructions properly or hallucinated some content?
Did it make a mistake because the prompt was unclear/open to interpretation or plain wrong?
Did it make a mistake because it lacked some context? Or too much context and it starts getting confused?
Is not handling edge cases automatically when that was not requested a mistake?
I am not just trying to defend LLMs, in many cases they make obvious mistakes and just don’t follow my arguably clear instructions properly. But sometimes it is not so clear cut. Maybe I didn’t link a relevant file (you can argue it could have looked to it), maybe my prompt just wasn’t that clear etc
If I take the example of code, but that extends to many domains, it can sometimes produce near perfect architecture and implementation if I give it enough details about the technical details and fallpits. Turning a 8h coding job into a 1h review work.
On the other hand, it can be very wrong while acting certain it is right. Just yesterday Claude tried gaslighting me into accepting that the bug I was seeing was coming from a piece of code with already strong guardrails, and it was adamant that the part I was suspecting could in no way cause the issue. Turns out I was right, but I was starting to doubt myself
I mean I do agree, and on iNat I can clearly see my house and the house of a few other people in the neighborhood. However you can easily find the current owner information for a given house in the state I live in, and since we bought the house, our name.
I guess it is different once you look at people renting, and also you could track a specific person posts to see when they are posting away from home for example. But as far as revealing your home address, sadly there are many other ways in a lot of cases
I am not sure, but you don’t have to technically bet on assassination. You can bet on an event which would happen as a result of said assassination. X won’t get re-elected. Company Y CEO will change in 2027. This is artist Z last tour. Athlete K won’t participate in this event etc.
The issue is the combined risk of insider trading coupled with the bias of disaster-centric betting, or at least event-centric betting. This means if you have the means to create an “out of the ordinary” event you have a strong incentive to make it happen and to bet on it. These must be controllable events, so not natural or complex systems. On the gentler side it would be sports fixing, which has always existed. On the worse side it would be causing war, making economic decisions that will impact many, betting on people death and so on. These kind of things are seemingly already happening to a certain degree.
I am curious about how much energy needs to be expanded to contain the anti-matter. Say it the matter/anti-matter is to be used for propulsion/energy generation can we reach a threshold were we are actually energy positive
Yes it feels like a full time job just to try to keep up. And I’ve been in AI for close to 10 years so I feel like I have to keep up at least a minimum.
An other thing for me is that it has gotten a lot harder for small teams with few ressources, let one person, to release anything that can really compete with anything the big player put out.
Quite a few years back I was working on word2vec models / embeddings. With enough time and limited ressources I was able to, through careful data collection and preparation, produce models that outperformed existing embeddings for our fairly generic data retrieval tasks. You could download from models Facebook (fasttext) or other models available through gensim and other tools, and they were often larger embeddings (eg 1000 vs 300 for mine), but they would really underperform. And when evaluating on general benchmarks, for what existed back then, we were basically equivalent to the best models in English and French, if not a little better at times. Similarly later some colleagues did a new architecture inspired by BeRT after it came out, that outperformed again any existing models we could find.
But these days I feel like there is nothing much I can do in NLP. Even to fine-tune or distillate the larger models, you need a very beefy setup.
Might be surprising but I am kinda willing to believe it. Since we bought our house, we had quite a bit of work done by professionals. But whenever I can I do things myself.
Like I had multiple companies quote me $300-500 based on the job for things that take me maybe 2-3 hours total to do, including learning about it (will be faster next time), getting the materials, and doing the job.
When you have a few of these a months they add up. It is usually nothing for a month and then 4-5 things to fix/improve the next
I remember having to describe a standard model to predict online shopping behaviors for my ML class exam in university. That was close to 10 years ago now.
Also remember a teacher telling us about that story of a company finding a woman was pregnant from her shopping behavior and pushing relevant recommendation. Prompting people around her like her dad or something to find out she was pregnant
But If I send a message with more than one question, there is what feels like a 10% change they will answer all my questions and a 90% chance they will either answer one or none and I’ll just get an “ok”. And I am talking about 5 lines messages not 50 lines.
So I have to send my questions one at a time, wait sometimes minutes to hours for an answer, then send the next one.
Of course I can also call, but often can’t reach them. Or can reach the front desk that doesn’t have the answers. I understand people are busy but it turns something that should be one message into a cat and mouse game