dingdingdang

10 日前議論

In a sense it's a clean reminder that all these, especially non-local, llm tools should NEVER run outside a container. I'm currently looking at z-jail specifically for these scenarios; VMs are too heavy & expose too many sec issues of their own for continual integrated use in my case.

dingdingdang

11 日前議論

Yeah, it works though, and the content is genuine enough which I guess trumps the issue with the title for me ;)

dingdingdang

12 日前議論

OK, I appreciate your excitement and the work you've done here. Also; when presenting a benchmark it -needs- to be done as a comparative measure, i.e. how are those numbers on a vanilla 9b, let alone decent quant of 3.6-35b-a3b? What have you achieved here?

dingdingdang

13 日前議論

Honestly think a lot of this article is ai babble - check how it ends on several classic ai negative triples such as "you’ll pay both bills on it just the same — plus you’ll comprehend it less, because you didn’t write it." ... etc.

dingdingdang

21 日前議論

Brexit promised a solution just like loads of solutions had been promised within the EU framework prior to it - all these "solutions" were akin in that they were all promised (from left and right within the political establishment) and all not delivered. This is also why people seek to go outside the regular voting pattern with Reform, it's not cause they suddenly love something completely different but because the former voting pattern did not deliver improvements as expected.

dingdingdang

先月議論

I do find it fascinating how blatantly people lie about things, the article mentions "Organic farming uses 84% more land for the same yield, but yields are 55% lower by area than conventional." yes, and that is the exact signature indicating that organic produce receives less harsh chemicals and is less exploitive of the ecosystem than "regular" produce. Not worth the read, it's simply anti-organic propaganda. Note: I'm not personally religious about organic/not-organic but neither do I enjoy overt misinformation campaigns.

dingdingdang

先月議論

This is a a worthy legal gofundme if I ever saw one!

dingdingdang

先月議論

"... the city for $10, the city sold it, and when the family went to court their suit was dismissed."

dingdingdang

先月議論

By pointing out the exact things that will likely happen you are oddly enough hedging against (at least some of them) happening!

A) I reckon it's true that smaller models will continue to improve massively through optimization and better and better harnesses, this tech is all still very young and A LOT of resources and (good-)will is being thrown at it.

B) The 1T+ models will be able to sideload and improve upon a lot of the fundamental improvements that happen to the smaller models to speed up incredibly while getting better at tools while (on a gradient) getting -more- things right.

C) More of an observation that I think is worth keeping in mind clearly; Karl Popper's black swan and all, truth in our temporal world IS a gradient!

dingdingdang

先月議論

Yes, it worth aiming for common sense as a bare minimum, chaos and entropy only grows when things we don't understand are casually derided/attacked.

dingdingdang

2 か月前議論

Worse in my opinion since the look is simply Tesla (whether one likes that or not), no one would have blinked an eyelid if Tesla released this car whereas Ferrari doing so comes off incoherent.

dingdingdang

2 か月前議論

Excellent practical guide and pictures, if OP is around on this thread: well done! Your future self is going to appreciative too when this needs repeating at some point!

dingdingdang

2 か月前議論

Gotta admit this was the first thing I thought of as well. Hard to focus on the code implementation with that in mind!

dingdingdang

2 か月前議論

These days it's for sure the dev environment that is lacking, hardware is okay (potentially great?!), software abysmal. To run a local llm in a stable manner implies using Vulkan.. any attempt at ROCm is totally hamstrung by haphazard support of hardware alongside with an online presence poisoned by people primarily discussing work-arounds rather than work when it comes to AMD as a platform. Argh.

dingdingdang

3 か月前議論

It's sad that they have gone political whereas their goal should, in my optics, be almost technocratically in favour of their own stated goals of "protecting user privacy from government/corporate surveillance, defending free speech online, enforcing net neutrality, promoting encryption, and combating abusive intellectual property laws".

dingdingdang

3 か月前議論

I do find the down votes odd, comment seem to contribute to the discussion, is it a reflex move because of intense dislike of the sitting US president?

dingdingdang

3 か月前議論

Having your stuff stored in another country is ultimately a voucher of confidence, I can't see Trump or anyone else willingly misusing that trust. I do think the Western leaders need to temper their tendencies for isolationism these days, what's the alternative guys? And why even think that other people/cultures will want you in their swimming-pool if you can't keep your own one clean/functional?

(this comment also covers France recently bringing home their gold)

dingdingdang

3 か月前議論

But then there's this: "When evaluating the complete bun install improvements, it came out speed-wise to about the same as the existing git usage (due to networking being the big bottleneck time-wise despite more cases being slightly faster with ziggit over multiple benchmarks). Except, it's done in 100% zig and those internal improvements pile up as projects consist of more git dependencies. All in all, it seems like a sensible upstream contribution."

Sooo, after burning these 10k+ worth of tokens we find out that it's sensible to use it because the language (zig) feels good as opposed to git itself which now has +20 years of human eval on it. That seems. Well. Yeah...

dingdingdang

4 か月前議論

Yep. that's the route I tried before, no good, maybe it's just that the documentation is past it's sell by date, maybe it's lack of community use.. I'm just not seeing it. Even the article itself describes how to make an exe file... that will then work in Linux? Or is it simply a program that's easier to run on Wine? Loads of text with unclear details throughout it.

dingdingdang

4 か月前議論

With this exact point in mind: I've recently written a pretty straight forward win32 c implementation of a utility with some context dependent window interactions and a tray icon to help monitor and facility reload of config file.

Is there any way I can use the Wine project to facilitate this compiling and running straight under x11/linux environment as a integrated project that doesn't require the end user to fiddle with Wine? I don't mind bundling shared code as needed. Help appreciated, I tried hard and failed at this endeavour priorly.

コメント