HackerTrans
TopNewTrendsCommentsPastAskShowJobs

skdotdan

no profile record

comments

skdotdan
·ano passado·discuss
Personally, I use LLMs to write code that I would have never bothered writing in the first place. For example, I hate web front-end development. I'm not a web dev, but sometimes it's cool to show visual demos or websites. Without LLMs, I wouldn't have bothered creating those, because I wouldn't have had the time anyway, so in that case, it's a net positive.

I don't use LLMs for my main pieces of work exactly due to the issues described by the author of the blogpost.
skdotdan
·ano passado·discuss
Not true. VAT does way less economic damage. Tariffs introduce massive distortions in the market.
skdotdan
·há 2 anos·discuss
Edited
skdotdan
·há 2 anos·discuss
As an anecdotal data point, I’m happier than in my early and mid 20s, and I have hope for my 30s.
skdotdan
·há 2 anos·discuss
This is not what hallucination means in the pre-LLM machine learning literature.
skdotdan
·há 2 anos·discuss
It’s used incorrectly. Hallucination has (or used to have) a very specific meaning in machine learning. All hallucinations are errors but not all errors are hallucinations.
skdotdan
·há 2 anos·discuss
What do you mean by “true” RL?
skdotdan
·há 2 anos·discuss
The way I see it hallucination and factual error are particular cases of incorrect answer.
skdotdan
·há 3 anos·discuss
Deepmind tried something similar in 2018 https://deepmind.google/discover/blog/learning-to-write-prog...
skdotdan
·há 3 anos·discuss
Cool! Thanks!
skdotdan
·há 3 anos·discuss
Rust is great, but one thing I’d like to see is an interpreted, dynamic, less strict version of it that could be used for prototyping and gradually typed into compiling Rust code. In other words, a new programming language doing to Rust the reverse of what Mojo is trying to do to Python.
skdotdan
·há 3 anos·discuss
I believe the main Mojo use cases are scenarios in which you'd need dependencies anyway. Code that you can't write in Python due to performance concerns, so you'd need to call C/C++/Rust/CUDA/Triton/etc anyway.
skdotdan
·há 3 anos·discuss
I'm sure Chapel has its merits, but one of the main selling points of Mojo is the aspiration to be part of the Python ecosystem, and so far I haven't seen any other programming language offering a similar promise, other than Python itself coupled with DSLs or other extensions for high performance.
skdotdan
·há 3 anos·discuss
The term of “hallucination” referred to generative ML models have been used in the literature for years, at least since GANs.L
skdotdan
·há 3 anos·discuss
I graduated in 2019 and studied Prolog in my third year.
skdotdan
·há 3 anos·discuss
Looks great! Rust is the wrong language for developing ML models, but it has a clear potential for being the best one for deploying them.
skdotdan
·há 3 anos·discuss
Aren’t iMessage and FaceTime irrelevant outside from the US? I don’t know a single non-American person who uses them.
skdotdan
·há 3 anos·discuss
Not an expert in East Asian languages, but GPT tokenizers are generally byte-based. Meaning that the basic unit to do the merges is a single byte, not a character.
skdotdan
·há 3 anos·discuss
I’d add that while languages should die, code written in it shouldn’t. So, even if a language is deprecated, we still should be able to run, call and interoperate with all the legacy code that was written in it.
skdotdan
·há 3 anos·discuss
https://huggingface.co/google/flan-ul2

https://huggingface.co/docs/transformers/model_doc/gpt_neox