zepearl

no profile record

Submissions

How I launched 3 consoles and found true love at Babbage's store no. 9 (2013)

arstechnica.com

79 pointsby zepearl5 เดือนที่ผ่านมา33 comments

comments

10 วันที่ผ่านมาdiscuss

> I have trouble getting my computers to copy data between each other anywhere near the theoretical limit for a 1 Gbps NIC, despite being connected through only a single switch.

Maybe your LAN cables have deteriorated?

Reaching 100 MiB/s should be easy peasy for a PC; in my case (2 10Gbps switches) by using nvme SSDs I reach almost 950 MiB/s and with 4x raidz1 HDDs I reach 450-650 MiB/s.

Until a few years ago I was smoking in my flat and often I had to change lan cables (whatever's in the smoke was sticking to the connectors)

13 วันที่ผ่านมาdiscuss

> Synchronously updated materialized views...

Oh yes, I'd love them too (if you're referring to, in Oracle slang, "...update on commit") - and it would be cool to have as well the option for a lazy update ("on demand" by taking into consideration only the records that have been changed since the last refresh, to handle multiple updates in a single pass - not sure how Oracle can achieve that technically...). This would be in my opinion a fantastic added functionality compared to basically all other (OLTP?) opensource DBs.

And: I'm really curious about the "OrioleDB" project... ( https://github.com/orioledb/orioledb/releases ) as a few years ago I was struggling a lot with "vacuum" of a kind-of-temporary table that had quite high amounts of continuous random inserts & deletes (problem solved by accumulating more changes in RAM before flushing them to the table therefore increasing amount of rows changed per "page", but I had to sweat a lot to find a good balance...).

15 วันที่ผ่านมาdiscuss

In my case it somehow depends a lot on the task being performed... .

E.g. when doing text transcription/OCR from images (Qwen 3.6 27B Q4_K_M by Bartowski) with a context size of ~50k I get a pp of ~460 tokens per second and a generation ranging from 35 to 45 tokens per second (using "--spec-type draft-mtp --spec-draft-n-max 2" currently with llama.cpp b6548).

On the other hand when handling code (Qwen 3.6 27B Q5_K_M by Bartowski) with a context size of 128k I get a pp ranging between 500 to 1500 tokens per second and a generation between 25 and 40 tokens per second (using in this case as well "--spec-type draft-mtp --spec-draft-n-max 2" currently with llama.cpp b6548).

Anyway in theory with "--split-mode layer" I think that it's anyway the slowest card that drives the overall performance (I do see in "nvtop" that usually the 5070 is ~25% active, the 5060 ~50% and the 3060 ~75%).

15 วันที่ผ่านมาdiscuss

I always run just one model at once, I switch between them depending on what I do (e.g. Qwen3.6 27B Q5_K_M by Bartowski when programming with "OpenHands" and when doing OCR text transcription and transformation, Gemma4 31B-it Q5_K_M by Bartowski when chatting in Open WebUI doing general tasks).

16 วันที่ผ่านมาdiscuss

I agree. To run an acceptable model (e.g. Qwen/Qwen3.6-27B or google/gemma-4-31B) with a good quantization (minimum Q5) with a good context size (min 64k) you could buy 2 or even 3 GTX 5060 16GiB VRAM for ~550$ each. Fyi the much faster MoE models were useless for my usecases - e.g not able to correctly identify me/I/you, endless thinking loops, etc.

I'm currently running those models using an RTX 5070 12GiB + RTX 5060 16GiB + RTX 3060 12GiB with a 96k context size with MTP/speculative decoding and I'm quite happy (the 5070 is about 4x faster than the 3060, the 5060 is inbetween them so about 2x faster than a 3060).

เดือนที่แล้วdiscuss

It's the AI. Everything gets answered (somehow), no direct questions need to be asked anymore.

(you're right - I was wondering the same thing 1h ago :o) )

เดือนที่แล้วdiscuss

This...

Right now the biggest threat to their IPO's is that people realize that local models are good enough for whatever they're peddling...

...plus the recent price increases by AI companies, made me actually think the opposite: that there might be another additional "run" for memory and/or GPUs.

Therefore, yesterday I decided to order an additional RTX 5060 with 16 GiB VRAM for the ~500$ that I saved during the last months (to be added to the RTX 5070 12 GiB that I bought last year to play games in 4k + my old RTX 3060 12 GiB which I recycled a few months ago after noticing how nice it is to run llama.cpp locally without having to worry about subscription costs).

The original 24 GiB VRAM were actually quite enough for some of the stuff that I do (e.g. transcribe text of image scans of old magazines, coding with Aider, etc - I usually use Q5_K_M quantizations of Qwen & Gemma by Bartowski as lower ones delivered sometimes weird results and/or looped forever in "thinking"-mode), but I guess that with 40 GiB I should be bullet-proof for my pessimistic view of our future :o)

2 เดือนที่ผ่านมาdiscuss

damn you're right, thx

2 เดือนที่ผ่านมาdiscuss

So if I understand correctly 3 modules are involved:

- esp4 (kernel config "CONFIG_AF_RXRPC")

- esp6 (kernel config "CONFIG_INET_ESP")

- rxrpc (kernel config "CONFIG_INET6_ESP")

Is this correct?

2 เดือนที่ผ่านมาdiscuss

Thanks a lot!!!

I was running in Gentoo "6.18.18" (amd64) and the exploit worked (and all other shells which I PREVIOUSLY opened could then just execute "su -" without password to become "root") -> doing temporarily a "modprobe -r algif_aead" on-the-fly did not fix it as I was still able to swap to "root" from the unprivileged user by executing just "su -".

"6.18.25" fixed it (module "algif_aead" still running).

- Maybe older Kernel versions that don't contain the fix should be blacklisted?

- FYI in Gentoo I had to recompile "sys-fs/zfs-kmod" after the minor kernel upgrade (I initially skipped it, but after rebooting with the new kernel I could not mount my raidz1) -> the same might be needed for other external modules.

4 เดือนที่ผ่านมาdiscuss

Using X (at least in this context?) is weird.

4 เดือนที่ผ่านมาdiscuss

I downloaded Ollama ( https://github.com/ollama/ollama/releases ) and experimented with a few Qwen models ( https://huggingface.co/Qwen/collections ).

My performance when using an RTX 5070 12GiB VRAM, Ryzen 7 9700X 8 cores CPU, 32GiB DDR5 6000MT (2 sticks):

  - "qwen2.5:7b": ~128 tokens/second (this model fits 100% in the VRAM).
  - "qwen2.5:32b": ~4.6 tokens/second.
  - "qwen3:30b-a3b": ~42 tokens/second (this is a MoE model with multiple specialized "brains") (this uses all 12GiB VRAM + 9GiB system RAM, but the GPU usage during tests is only ~25%).
  - qwen3.5:35b-a3b: ~17 tokens/second, but it's highly unstable and crashes -> currently not usable for me.

So currently my sweet spot is "qwen3:30b-a3b" - even if the model doesn't completely fit on the GPU it's still fast enough. "qwen3.5" was disappointing so far, but maybe things will change in the future (maybe Ollama needs some special optimizations for the 3.5-series?).

I would therefore deduce that the most important thing is the amount of VRAM and that performance would be similar even when using an older GPU (e.g. an RTX 3060 with as well 12GiB RAM)?

Performance without a GPU, tested by using a Ryzen 9 5950X 16 cores CPU, 128GiB DDR4 3200 MT:

  - "qwen2.5:7b": ~9 tokens/second
  - "qwen3:32b": ~2 tokens/second
  - "qwen3:30b-a3b": ~16 tokens/second

5 เดือนที่ผ่านมาdiscuss

What about pre-December_2022? I cannot imagine that just a handful were imported.

7 เดือนที่ผ่านมาdiscuss

> The main reason for this is lack of competition for DB in Germany

Cannot be - there is no competition in Switzerland, but things run pretty smoothly -> in the case of Germany I'd rather say: "lack of oversight, controls, 'konsequent zu sein'" -> in the case of Germany's DB I think that nobody at all levels gives a *hit about its problems.

7 เดือนที่ผ่านมาdiscuss

I interpreted your post like what "krupan" posted in the separate sub-thread ("This is a much tighter circle than any of us should be comfortable with"), but maybe others interpreted it differently (the words of your post are quite generic...). Cheers :o)

9 เดือนที่ผ่านมาdiscuss

To fix stuttering I had to disable compositing in the window manager (Xfce on Linux Mint, nVidia proprietary with AMD CPU).

10 เดือนที่ผ่านมาdiscuss

Fully agree - such a great movie: absolutely flowing, entertaining, fantastic characters, nice colors. That together with "Three days of the Condor" is what I immediately though of when I heard the news, but so far only one of the newspapers/sites I read has mentioned both of them..., weird :o| Am I just getting too old (respectively, are articles being written by too junior people?)?

3 ปีที่แล้วdiscuss

> But once you achieve market dominance, your priorities have to shift. It's no longer "why wouldn't you try this" or "let's do the right thing." It's "why would you rock the boat and risk the nice thing we have?" It's not just about profit. Careers and incomes are at stake. People will get hurt.

I don't get this.

Why did they kill so many products which were running on standalone tracks? (at least in my opinion)

If I look at https://killedbygoogle.com I see for example "Stadia", "Podcasts", "Domains", etc... - in my opinion those projects would not conflict with their current main activities being Internet search & email service, respectively whoever is involved in it (ok, maybe excluding allocations of budget - but it's not that Google has currently liquidity problems so it's not that budget for existing depts would have to be reduced...).

4 ปีที่แล้วdiscuss

thx

4 ปีที่แล้วdiscuss

But isn't that just part of Wireguard itself? In the end that's what's happening in my case when I exchange data through Wireguard between my flat and the one of my parents... .