HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jononor

4,030 karmajoined 12 anni fa
Machine Learning and Software Engineer. Specialized in sensor data / IoT and audio ML. Teach digital fabrication at local makerspace.

Website: http://jonnor.com https://github.com/jonnor/

comments

jononor
·11 ore fa·discuss
Writing a Python extension would a good way to dip your toes into Rust, and also add a useful skill to Python programming (writing performant extensions). PyO3 is the main project, and the topic has been covered in several talks at Python conferences (check Youtube).
jononor
·18 ore fa·discuss
There are no limits to what you can imagine yourself hearing... And appreciation is a extremely complex subjective feeling, one could argue most of that is way beyond audio and acoustics, and even beyond psychacoustics into plain psychology. When talking about the sensation, it is hard to differentiate between "really hear" versus "tricking oneself" - for most intents and purposes this is one and the same..

On the other hand, one can conduct blind tests that show that many phenomena cannot be reliably differentiated by a listener. Different listeners also have different levels of ability to discriminate sounds and sound quality. So when testing audio equipment using listening tests, one needs to consider the panel of listeners that one uses. Typically there are trained panels of listeners (who have received basic training and shown statistically an ok ability to discriminate) and "consumer" panels which are just random people off the street. The two groups will give very different ratings -especially for "medium" sound quality equipment.

For info on the former, see any decent book on psychoacoustics. And for the latter see for example Sensory Evaluation of Sound (Nick Zacharov et al).
jononor
·ieri·discuss
Or "this code (which you happened to write) is bad" vs "you are a shitty programmer".
jononor
·l’altro ieri·discuss
I believe the proposed system is to run the containers on dedicated rented server(s). Instead of having the containers/VMs share underlying CPU/RAM with others.
jononor
·3 giorni fa·discuss
Also, many of the successful European companies are bought up by US companies.
jononor
·3 giorni fa·discuss
GB200 and GB300 are decent for training LLMs? H100 can be used also? Though the current European deployments are rather small, even the biggest are just some thousand GPUs.
jononor
·3 giorni fa·discuss
EU already has supercomputers and data centers. Some examples: https://www.eurohpc-ju.europa.eu/supercomputers/our-supercom...

The goal is to triple the number of data centers over the next years. It is not like there is nothing going on...
jononor
·3 giorni fa·discuss
You also need a shitton of data. People are saying that synthetic data is widely used, but pretty sure that is on top of the organic data. Both for pretraining and posttraining. That said, I do think we will see more open and collaborative approaches over time.
jononor
·9 giorni fa·discuss
Prior to AI making a PR involved considerable effort from a human. So the default position for many open source projects was that it deserved some level of attention for the effort. Even if many projects in practice would struggle to review every PR. But with AI tools this dynamic has shifted dramatically - many PRs have basically zero effort been put into it. Additionally there are many more of them, and often way bigger also.
jononor
·12 giorni fa·discuss
Many people in LocalLLaMA Reddit community has been reporting the same, that 3.5 122B-A10B is on par or slightly better. And a 3.6 or 3.7 od the 122B is one of the models people want to see the most.
jononor
·18 giorni fa·discuss
Not only that, but such a node is fully booked with existing orders, many which are long term commitments with penalties if they fail to deliver.
jononor
·25 giorni fa·discuss
Dual 5060ti 16gb does over 100 tok/s on 35B A3B. Even with PCIE Gen 4 x4, which quite a lot of motherboards can do. Though Gen 4 x8 or Gen 5 x4 is slightly faster. Misc working notes on this hardware combo here, https://github.com/jonnor/embeddedml/tree/master/handson/mic...
jononor
·mese scorso·discuss
Dual color filaments exist, and they do not mix at all... It gives the objects a nice transition when rotated. But indicates that color mixing in the nozzle is probably pretty difficult?
jononor
·mese scorso·discuss
That OpenAI was in the wrong when they ignored everyone copyright, does not make it right to ignore their ToU. If a one wants IP and rule of law (incl contracts) to be respected, one should not violate others rights when it is convenient.

On a more risk-strategy level there is the size of their legal team, general endowment, and supplier and political connections to consider.

Everyone is free to ignore their ToU, but I can understand why a company would avoid it...
jononor
·mese scorso·discuss
A 10'000 hour entry fee does rule out a fair bunch of people though, in practice. While there are few artificial barriers to learning to code, there still are some natural ones, like time.
jononor
·mese scorso·discuss
I do not know which is easier. I am not sure that is even well established in research for generative text tasks whether a translation-first or native-language-first is the most sample efficient?

But for a national lab I think it is money well spent to figure out the possibilities and limitations of a native-language LLMs for languages with order of 5M-10M speakers.
jononor
·mese scorso·discuss
These models will never compete with frontier models and do not need to - it is about hitting a good-enough, not being the best. Behind the frontier, getting to a certain performance level, is getting easier over time - both sample and compute efficiency is going up.

Furthermore one can reuse investments in data (both agreements, infrastructure and datasets), compute (GPUs, servers) and know-how (training scripts, experienced engineers).
jononor
·2 mesi fa·discuss
It would require an investment, but those will pay dividends later, as it becomes easier to train LLMs on/for Norwegian. If we need to translate everything to English we might as well just drop using Norwegian altogether. Practically everyone speaks English fluently already...
jononor
·2 mesi fa·discuss
WebSerial in Firefox?! Finally! One of the very few things I use chrome for.
jononor
·2 mesi fa·discuss
Yeqh that is a challenge. DDR5 and LPDDR5X are both manufacturable with DUV. So let's hope they still get access to that...