HackerTrans
TopNewTrendsCommentsPastAskShowJobs

albertzeyer

no profile record

comments

albertzeyer
·قبل 12 يومًا·discuss
Small self-advertisement: as an alternative to dissect.cstruct, a fun side-project of mine (C parser + C interpreter in Python) can do a very similar thing:

https://github.com/albertz/PyCParser/blob/master/demos/disse...
albertzeyer
·الشهر الماضي·discuss
I think the simulation in Cities Skylines is also quite advanced, or not? The simulation is much more the reason why it requires powerful hardware to run on, much less the graphics.
albertzeyer
·قبل شهرين·discuss
More information about DwarfStar 4 (DS4) in the readme: https://github.com/antirez/ds4

The code seems based on llama.cpp and GGML.

I don't fully understand why it is a standalone project. The readme discusses this: DwarfStar 4 is a small native inference engine specific for DeepSeek V4 Flash. It is intentionally narrow: ...

I think the only bigger difference in DeepSeek V4 vs other models is maybe the type of self-attention. And that leads to: KV cache is actually a first-class disk citizen.

But I still feel like those changes could have been implemented as part of some of the other local engines.

I also assume more models will come out, not just from DeepSeek but also from others, and they might share similar self-attention approaches, that would benefit from a similar KV cache implementation.
albertzeyer
·قبل شهرين·discuss
The classic function coloring problem. https://journal.stuffwithstuff.com/2015/02/01/what-color-is-...
albertzeyer
·قبل شهرين·discuss
Why not just getting the changes/extensions upstream, welcome the Mac dev on the team, and make it an official port?
albertzeyer
·قبل شهرين·discuss
But these are not errors. These are just warnings you can ignore? It's not really so critical?
albertzeyer
·قبل 3 أشهر·discuss
I'm curious: In the current moon flyby, how often did some of these fallback methods get active? Was the BFS ever in control at any point? How many bitflips were there during the flight so far?
albertzeyer
·قبل 3 أشهر·discuss
73°C is a bit unusual cold for a Finnish sauna. Wikipedia says:

> The temperature in Finnish saunas is 80 to 110 °C (176 to 230 °F), usually 80–90 °C (176–194 °F)

And with that temperature, I think 10–15 minutes are pretty standard.
albertzeyer
·قبل 3 أشهر·discuss
Is that real-time or sped up? This video is about 1 minute. How much real time does it correspond to?
albertzeyer
·قبل 5 أشهر·discuss
I wonder a bit about that. What activities or possibilities are you exposed at during that age.

I know many computer science colleagues who were not exposed to programming during that age and only later came to it.

I feel kind of lucky that somewhat randomly I stumbled into computer programming (because XtreeGold could show the content of files, and I was learning to understand BAT-files by looking into them) during that age, and that's what I do now.

There are probably a lot of things you were not exposed during that age, that could have been the perfect match.

There are also lots of kids who just play games, or video games, do sports, watch films or so during that age, without really being exposed to any "potential useful" activities. Some parents would maybe even say that this is how it should be.

As a parent, I guess a good advice would be to try to expose your child to as much things as possible, without forcing it to do anything of course.
albertzeyer
·قبل 6 أشهر·discuss
https://wiki.python.org/moin/DebuggingWithGdb
albertzeyer
·قبل 6 أشهر·discuss
I had registered for alerts on https://aurorasaurus.org/. But that alert was sent way too late for me (strongest lights were yesterday around 10-11 PM, and the notification was sent 2 AM today). But I was very lucky and just noticed the lights by accident on my way home.
albertzeyer
·قبل 6 أشهر·discuss
v0: 16M Parameters

v0.5 123M Parameters

v1: 700M Parameters

v2mini-eval1: 300M Parameters

I would not call this LLM. This is not large. It's just a normal-sized LM. Or even small.

(It's also not a small LLM.)
albertzeyer
·قبل 7 أشهر·discuss
Very nice!

This is released under GPL.

I wonder, who is K1n9_Duk3? Does he have the rights to actually release this, and put it under GPL?

What does "reconstructed" mean? Is this disassembled? And if so, is it really ok to put this under GPL then?
albertzeyer
·قبل 7 أشهر·discuss
I think the point is that for most things, you don't need to call any external tools. Python's standard library comes already with lots of features, and there are many packages you can install.
albertzeyer
·قبل 7 أشهر·discuss
The first linked article was recently discussed here: RIP pthread_cancel (https://news.ycombinator.com/item?id=45233713)

In that discussion, most of the same points as in this article were already discussed, specifically some async DNS alternatives.

See also here the discussion: https://github.com/crystal-lang/crystal/issues/13619
albertzeyer
·قبل 8 أشهر·discuss
Which paper is that?
albertzeyer
·قبل 8 أشهر·discuss
This idea is often used for self-supervised learning (SSL). E.g. see DINO (https://arxiv.org/abs/2104.14294).
albertzeyer
·قبل 8 أشهر·discuss
The random noise is added to the model parameters, not the inputs, or not?

This reminds me of variational noise (https://www.cs.toronto.edu/~graves/nips_2011.pdf).

If it is random noise on the input, it would be like many of the SSL methods, e.g. DINO (https://arxiv.org/abs/2104.14294), right?
albertzeyer
·قبل 8 أشهر·discuss
> Presumably we still wouldn't enable Modules by default.