vervez · HackerTrans

3 tahun yang laludiscuss

There's also recent Bayesian Optimal Experimental Design methods that allow you to directly design experiments using gradient ascent. Not sure how it compares with BayesOpt on your problem, though.

vervez

3 tahun yang laludiscuss

github copilot won't pay for itself.

vervez

3 tahun yang laludiscuss

Their paper is more for the case of "we can't gather more data, so what to do?" but your solution is in line with optimal experimental design and choosing a utility function to distinguish between models using as little data as possible.

vervez

3 tahun yang laludiscuss

Here's a good recent paper that looks at this problem and provides remedies in a Bayesian manner. https://arxiv.org/abs/2202.11678

vervez

3 tahun yang laludiscuss

min{d(problem)/d(theta)} is essentially what LLMs are doing with a prompt. Every session that a chatgpt user has leads to either a resolution or not, which is the loss function given the prompt used to reach that point. It's getting better at not hallucinating in my experience over just the past 4 months.

vervez

3 tahun yang laludiscuss

Thanks for sharing and i'm happy to be your friend :)

vervez

3 tahun yang laludiscuss

I see your point and agree it can be frustrating if DEI initiatives are used as a political tool or blindly without considering the pitfalls of a naive implementation.

vervez

3 tahun yang laludiscuss

Indeed, I didn't cite any sources but I'm fairly sure there's literature studying this phenomenon. I agree that DEI when used as a political tool is a distraction for a company.

vervez

3 tahun yang laludiscuss

I think many of the things you mentioned w.r.t. diversity is actually forward-thinking and potentially yields more returns later. If there's a brilliant swe that feels uncomfortable at a company because of how they name their branches, they won't work there. Same goes for hiring a "less-qualified" individual. How many decisions or projects can be improved because of a diversity of input? Again, a non-linear outcome that is harder to measure than immediate profitability. Those are some arguments for those programs focusing on your productivity point.

vervez

4 tahun yang laludiscuss

Equivariance is growing in popularity in machine learning, so these tricks will be helpful if one wants to study, or publish, in that area (I'm thinking about it). I'd recommend for any ML-related folks to look into this area and save this thread whenever they're trying to implement an equivariant neural network.

vervez

4 tahun yang laludiscuss

So you `pip install`ed them at a new company? I'll see myself out.

vervez

4 tahun yang laludiscuss

Here's a short (unscientific) article (that kinda links to scinetific articles) about the link between lactic acid buildup and its relation in the brain. Sounds like exercise generates a natural nootropic. https://www.outsideonline.com/outdoor-adventure/lactic-acid-...

comments