HackerLangs
TopNewTrendsCommentsPastAskShowJobs

jph00

8,137 karmajoined قبل 16 سنة
Jeremy Howard -- answer.ai and fast.ai; hon professor at University of Queensland.

Submissions

Tool Shaped Objects

minutes.substack.com
3 points·by jph00·قبل 5 أشهر·0 comments

Let's Build the GPT Tokenizer: A Complete Guide to Tokenization in LLMs

fast.ai
20 points·by jph00·قبل 9 أشهر·0 comments

comments

jph00
·أمس·discuss
Heaven forbid we let poor people use software that helps their kids read.

If they can't afford a tutor, they deserve nothing.

(Am I doing this right?)
jph00
·أول أمس·discuss
It takes a lot of digging to find their cache pricing - it's $0.50, which is unusually expensive.

The vast majority of input tokens are normally cached, so this is actually the price that matters. I wonder why it's so high.
jph00
·قبل 6 أيام·discuss
Pythons options are here: https://docs.python.org/3/library/sqlite3.html

SQLite behavior is here: https://sqlite.org/lang_transaction.html . The regular implicit transactions there plus explicit where needed aren’t supported in any python mode.
jph00
·قبل 6 أيام·discuss
I'm a big fan of sqlite-utils, but I really don't like how Python (particularly 3.12+) changes how sqlite's transactions work -- the native behavior explained in the sqlite docs is much better IMO. I understand why Python had to change it (to be compatible with other databases) but I don't think it's a good model for sqlite.

Therefore, I created apsw-utils, a port of sqlite-utils to the amazingly-awesome apsw lib -- which is a really idiomatic sqlite lib for python. It's here: https://answerdotai.github.io/apswutils/

I've used it in lots of projects including in significant production stuff, and it's always worked great for me. IMO if you're serious about doing sqlite in python, at some point you'll probably want to check out apsw.
jph00
·الشهر الماضي·discuss
It's both an illogical question and comes from a place of ignorance about a topic which one would expect folks nowadays to have some basic competence in.

First, the illogical part: the statement was about "inequality" to which you asked about wealth generation. These are two separate issues, and inequality is not, logically, necessarily tied to wealth generation. So "How does creating wealth hurt others?" is, at best, a non sequitur.

The ignorance part: there is a lot of empirical research over many decades showing the negative impact of wealth inequality on societies. With Google and AI there's really no good reason to ask such ignorant questions when in a moment you could educate yourself, and then ask an informed and thoughtful question instead.
jph00
·الشهر الماضي·discuss
You seem to have a rather limited understanding of what kinds of concurrency exist and how those needs are best met. Whether something is a server or not is not very relevant to this discussion.

SQLite is an excellent production db for many real world workloads, as has been widely documented. It is very different to Postgres, so requires learning a whole new skill set.

One way to think about it is that SQLite can work well for the parts of your system where there is naturally strong partitioning.
jph00
·قبل شهرين·discuss
I couldn't find a CPAP mask that worked for me, even after 6 months of trying across 4 different masks.

Then I read studies showing oropharyngeal exercises can help treat sleep apnea. Originally I used https://snoregym.com/ for that, but then I switched to simply chewing gum once a day (being careful to chew on both sides of my mouth roughly equally), and also chewing my food a bit longer.

It totally cured my sleep apnea.
jph00
·قبل شهرين·discuss
q and ch both exist in pinyin, and have different sounds. The q sound requires placing the tip of the tongue on the teeth, and isn’t an initial consonant we have in English, so we don’t have a way to spell it.
jph00
·قبل شهرين·discuss
TIL HN still doesn't support rfc3492, 23 years after it was published, and so this domain is not rendered correctly on the site. :( (It should appear as: マリウス.com )
jph00
·قبل شهرين·discuss
He states in the article that they use LLMs for this purpose and find them extremely useful.
jph00
·قبل شهرين·discuss
There's always someone making this claim when negative comments about AWS come up.

They almost always come from people that don't have experience running substantive infra at scale without AWS, so they can't make an informed comparison. The complexity of doing so, for a lot of infra, turns out to be lower than using AWS. Also, you end up with transferable skills and a deeper understanding of the foundational protocols and systems. And you save a lot of money, both because you don't have to pay to manage that complexity, and the systems themselves are cheaper.
jph00
·قبل شهرين·discuss
The statement “there exists a project where zig led to an extremely high amount of crashes/memory bugs” does not imply “all zig projects have an extremely high amount of crashes/memory bugs”.

This is a classic logic problem - eg “there is an orange cat” doesn’t imply “all cats are orange”.
jph00
·قبل 3 أشهر·discuss
No, you are deeply misunderstanding the issue. Creating a rivalrous good that powers fight over for control, then use violence to maintain control of, creating a global feudalism, is not "existing oppression getting worse". It actually makes the risks of every human everywhere dying far higher, and even if that doesn't happen, decreases global utility by a similar percentage (99%, instead of 100%). It could actually be worse, if average human utility becomes negative.
jph00
·قبل 3 أشهر·discuss
"already substantially completed" isn't accurate. $450m of the eventual $1.65b cost had been spent at that point - so less than half.
jph00
·قبل 3 أشهر·discuss
Yeah this has always been the glaring blind spot for most of the "AI Safety" community; and most of the proposals for "improving" AI safety actually make these risks far worse and far more likely.
jph00
·قبل 4 أشهر·discuss
GPL was created as a workaround for copyright - it wouldn’t have been needed if there wasn’t copyright. There are complex arguments both for and against copyright and there’s no reason to simply assume it must always be just as now even as circumstances change.
jph00
·قبل 4 أشهر·discuss
Nearly all my coding for the last decade or so has used literate programming. I built nbdev, which has let me write, document, and test my software using notebooks. Over the last couple of years we integrated LLMs with notebooks and nbdev to create Solveit, which everyone at our company uses for nearly all our work (even our lawyers, HR, etc).

It turns out literate programming is useful for a lot more than just programming!
jph00
·قبل 4 أشهر·discuss
This is exactly the thinking that has characterized responses to new sources of power through history, and has been consistently used to excuse hoarding of that power. In the end, enlightenment thinking has largely won out in the western world, and society has prospered as a result.

Centralizing power is dangerous and leads to power struggles and instability.
jph00
·قبل 4 أشهر·discuss
In the alternative, asymmetry is guaranteed.

When you only allow gov and big tech access to powerful AI, you create a much more dangerous and unstable world.
jph00
·قبل 5 أشهر·discuss
Yes there is. Lots of researchers are more interested in making a contribution to societal flourishing than in making incredible sums of money. That’s why there’s still lots of top AI researchers in academia.