HackerTrans
TopNewTrendsCommentsPastAskShowJobs

mtdewcmu

1,437 karmajoined 14 वर्ष पहले

Submissions

Complexity theorist Steven Rudich (1961-2024)

blog.computationalcomplexity.org
16 points·by mtdewcmu·6 दिन पहले·0 comments

Data Compression Explained (2012)

mattmahoney.net
193 points·by mtdewcmu·26 दिन पहले·36 comments

Largest survey of physicists puts Standard Model of cosmology under scrutiny

phys.org
3 points·by mtdewcmu·2 माह पहले·0 comments

Microsoft Scales Back AI Goals Because Almost Nobody Is Using Copilot

extremetech.com
43 points·by mtdewcmu·7 माह पहले·18 comments

comments

mtdewcmu
·6 दिन पहले·discuss
Looks like the hardware this runs on has only 64 KB RAM.
mtdewcmu
·22 दिन पहले·discuss
I think that the common meaning of AI has changed since this was written. This book was written at least 14 years ago, long before anyone had heard of an LLM. Matt Mahoney incorporated neural networks in his compressors. Afaik they weren't pretrained. They were adaptive and made one pass over the plaintext, simultaneously learning and predicting. Decoding worked similarly.

If you go and (re)read what he writes in relation to AI, which I just did, it's about exclusion. He excludes "Universal Compression" as impossible, Kolmogorov compression as uncomputable, and then he gets to Artificial Intelligence. Artificial Intelligence is an appropriate way to model data, since data is created by humans with human intelligence. And, AI doesn't violate mathematics the way Universal Compression and Kolmogorov solutions do. So therefore, Artificial Intelligence is what's left. That seems to be the argument.
mtdewcmu
·22 दिन पहले·discuss
Really nice guy, also.
mtdewcmu
·22 दिन पहले·discuss
When decompressing, you need to reproduce the output of the LLM exactly as it was during compression, otherwise the decompressor would output gibberish. Can you count on the LLM being that consistent?
mtdewcmu
·22 दिन पहले·discuss
Fabrice Bellard did something with neural nets and a transformer model [1] that was very successful.

I suspect that LLMs wouldn't be ideal to use as compressors, because they are large, consume a lot of resources, and are constantly changing. You need the model to produce exactly the same output at encoding and decoding time, or else you get gibberish.

[1] https://bellard.org/nncp/
mtdewcmu
·26 दिन पहले·discuss
Is sel4 an OS kernel created by Jane Street?
mtdewcmu
·2 माह पहले·discuss
>> Retatrutide is incredible in a mind altering way

>> and all just love the way it makes you feel

Maybe it will turn out to be an antidepressant as well. That would be quite a coup.
mtdewcmu
·4 माह पहले·discuss
You could write imperative code in Racket without much difficulty, as long as you don't mind the exclamation points.
mtdewcmu
·7 माह पहले·discuss
Mine is GNU WoMan, an alternative to man.

https://www.gnu.org/software/emacs/manual/html_mono/woman.ht...
mtdewcmu
·7 माह पहले·discuss
Racket has packages (1) that work quite well. Chicken Scheme has Eggs.

(1) https://docs.racket-lang.org/pkg/index.html
mtdewcmu
·7 माह पहले·discuss
I think they also make money from people that don't know the difference and use it because, for instance, it's the default in Edge when you search from the URL bar.
mtdewcmu
·7 माह पहले·discuss
This all reminds me of Bing. It already lost the technology race, but it serves MS's own interests to keep it around, apparently.
mtdewcmu
·7 माह पहले·discuss
I started learning Common Lisp, but ASDF and Quicklisp threw me off. I couldn't tell if you were supposed to choose one or the other or they were used together. This might revive my interest in Common Lisp if I get around to reading it. But in the meantime I drifted off to Racket, which is relatively well documented and has extensive libraries and really unique features.