HackerTrans
TopNewTrendsCommentsPastAskShowJobs

matanyall

no profile record

Submissions

Llama3 on Groq

groq.com
35 points·by matanyall·2 yıl önce·7 comments

Ask HN: What are folks using for dealing with K8s manifests these days?

2 points·by matanyall·2 yıl önce·0 comments

comments

matanyall
·6 ay önce·discuss
It's so funny, I've never done a cost-benefit analysis of having "good monitoring" and then still not being able to figure out what broke and needing to pull in someone who doesn't need the monitoring at all because they built the thing.
matanyall
·geçen yıl·discuss
Can we just have something that replaced the page with test datasets and Disney IP to poison the training data? Or maybe just embed it into the page itself, but hidden?
matanyall
·2 yıl önce·discuss
git add passions.xml; git commit -m "feat: commitments"; git push
matanyall
·2 yıl önce·discuss
Lol, I love it
matanyall
·2 yıl önce·discuss
+1 for fastAPI
matanyall
·2 yıl önce·discuss
Gambling has a similar addiction profile to cigarettes and other drugs, so why not have the same kind of labels on every bet and app, something like, "FanDuel is legally required to tell you that sports gambling has been shown to cause massive financial losses and is a major cause of divorce."

I am also against specifically state sponsored gambling like the lottery. At least (non casino style day trading) investment in stocks has upside at all.
matanyall
·2 yıl önce·discuss
Why do people do things? Doing things is falsely valued.

(Am partially sentient collection of coral, YMMV)
matanyall
·2 yıl önce·discuss
Damn, y'all ok over there in Nixland?
matanyall
·2 yıl önce·discuss
$0.59 input, $0.79 output (https://wow.groq.com/)
matanyall
·2 yıl önce·discuss
This is a huge issue. What's the point of doing replication studies (which we need) if folks just don't care about the result.

It's heavy handed, but I think every time a study fails to reproduce its results, every single published paper that uses that refuted study is notified, the authors get 6 months with a warning banner on top of the article, and if a correction is not submitted, it's automatically removed.

Science isn't supposed to be easy. We need a system that prioritizes high quality output, not volume.
matanyall
·2 yıl önce·discuss
Groq Engineer here, I'm not seeing why being able to scale compute outside of a single card/node is somehow a problem. My preferred analogy is to a car factory: Yes, you could build a car with say only one or two drills, but a modern automated factory has hundreds of drills! With a single drill, you could probably build all sorts of cars, but a factory assembly line is only able to make specific cars in that configuration. Does that mean that factories are inefficient?

You also say that H200's work reasonably well, and that's reasonable (but debatable) for synchronous, human interaction use cases. Show me a 30b+ parameter model doing RAG as part of a conversation with voice responses in less than a second, running on Nvidia.
matanyall
·2 yıl önce·discuss
Here we go again!
matanyall
·3 yıl önce·discuss
Yeehaw, here's to another year gone by!
matanyall
·3 yıl önce·discuss
Yeah, that's raw llama2 for you. Fine tuning, LoRa, that's how you get the nice responses.
matanyall
·3 yıl önce·discuss
Wow!