HackerTrans
TopNewTrendsCommentsPastAskShowJobs

matanyall

no profile record

Submissions

Llama3 on Groq

groq.com
35 points·by matanyall·vor 2 Jahren·7 comments

Ask HN: What are folks using for dealing with K8s manifests these days?

2 points·by matanyall·vor 2 Jahren·0 comments

comments

matanyall
·vor 6 Monaten·discuss
It's so funny, I've never done a cost-benefit analysis of having "good monitoring" and then still not being able to figure out what broke and needing to pull in someone who doesn't need the monitoring at all because they built the thing.
matanyall
·letztes Jahr·discuss
Can we just have something that replaced the page with test datasets and Disney IP to poison the training data? Or maybe just embed it into the page itself, but hidden?
matanyall
·vor 2 Jahren·discuss
git add passions.xml; git commit -m "feat: commitments"; git push
matanyall
·vor 2 Jahren·discuss
Lol, I love it
matanyall
·vor 2 Jahren·discuss
+1 for fastAPI
matanyall
·vor 2 Jahren·discuss
Gambling has a similar addiction profile to cigarettes and other drugs, so why not have the same kind of labels on every bet and app, something like, "FanDuel is legally required to tell you that sports gambling has been shown to cause massive financial losses and is a major cause of divorce."

I am also against specifically state sponsored gambling like the lottery. At least (non casino style day trading) investment in stocks has upside at all.
matanyall
·vor 2 Jahren·discuss
Why do people do things? Doing things is falsely valued.

(Am partially sentient collection of coral, YMMV)
matanyall
·vor 2 Jahren·discuss
Damn, y'all ok over there in Nixland?
matanyall
·vor 2 Jahren·discuss
$0.59 input, $0.79 output (https://wow.groq.com/)
matanyall
·vor 2 Jahren·discuss
This is a huge issue. What's the point of doing replication studies (which we need) if folks just don't care about the result.

It's heavy handed, but I think every time a study fails to reproduce its results, every single published paper that uses that refuted study is notified, the authors get 6 months with a warning banner on top of the article, and if a correction is not submitted, it's automatically removed.

Science isn't supposed to be easy. We need a system that prioritizes high quality output, not volume.
matanyall
·vor 2 Jahren·discuss
Groq Engineer here, I'm not seeing why being able to scale compute outside of a single card/node is somehow a problem. My preferred analogy is to a car factory: Yes, you could build a car with say only one or two drills, but a modern automated factory has hundreds of drills! With a single drill, you could probably build all sorts of cars, but a factory assembly line is only able to make specific cars in that configuration. Does that mean that factories are inefficient?

You also say that H200's work reasonably well, and that's reasonable (but debatable) for synchronous, human interaction use cases. Show me a 30b+ parameter model doing RAG as part of a conversation with voice responses in less than a second, running on Nvidia.