HackerTrans
TopNewTrendsCommentsPastAskShowJobs

SlavikCA

229 karmajoined 7 лет назад

comments

SlavikCA
·позавчера·discuss
Does Android have this feature?
SlavikCA
·18 дней назад·discuss
And with MTP (or other speculation techniques) you can ~double that.
SlavikCA
·22 дня назад·discuss
dual CPU is bad idea for inference: single CPU works few times faster than dual because of NUMA limitations.
SlavikCA
·2 месяца назад·discuss
where that usage data coming from?
SlavikCA
·3 месяца назад·discuss
There is no standard.

The higher quantization - the better results, but more memory is needed. Q8 is the best.
SlavikCA
·3 месяца назад·discuss
I'm getting 30 t/s on RTX 4090D (using 42 out of 48GB VRAM) with UD-Q6_K_XL

https://huggingface.co/unsloth/Qwen3.6-27B-GGUF/discussions/...
SlavikCA
·3 месяца назад·discuss
I'm running it on my Intel Xeon W5 with 256GB of DDR5 and Nvidia 72GB VRAM. Paid $7-8k for this system. Probably cost twice as much now.

Using UD-IQ4_NL quants.

Getting 13 t/s. Using it with thinking disabled.
SlavikCA
·3 месяца назад·discuss
Please offer new clients try it: at least let us to send few requests in the chat.
SlavikCA
·4 месяца назад·discuss
Thank you. Just tried it.

UI is rather confusing.
SlavikCA
·4 месяца назад·discuss
Great project!

Is there similar project for image editing?

Just basic features:

- cropping

- rotating

- brightness & contrast
SlavikCA
·5 месяцев назад·discuss
So, only Americans can use data against others?

By the way, I'm running 400B model on my computer with 72GB VRAM: Qwen3.5-397B-A17B-GGUF/UD-Q4_K_XL getting 13 t/s. Subjectively, I feel it's runs at the level of Anthropic Claude, just slower.
SlavikCA
·5 месяцев назад·discuss
Are you talking about Biden?

The Keystone XL pipeline had been partially constructed before President Biden revoked the permit on January 20, 2021 on his first day in office. About 300 miles had been completed when TC Energy officially abandoned the project.
SlavikCA
·6 месяцев назад·discuss
They told us that with AI you can vibe-code anything now...

So, no need to make old program to work. Just write new one.

/sarcasm
SlavikCA
·7 месяцев назад·discuss
The HuggingFace link is published, but not working yet: https://huggingface.co/MiniMaxAI/MiniMax-M2.1

Looks like this is 10 billion activated parameters / 230 billion in total.

So, this is biggest open model, which can be run on your own host / own hardware with somewhat decent speed. I'm getting 16 t/s on my Intel Xeon W5-3425 / DDR5-4800 / RTX4090D-48GB

And looking at the benchmark scores - it's not that far from SOTA (matches or exceeds the performance of Claude Sonnet 4.5)
SlavikCA
·7 месяцев назад·discuss
That screenshot / video on README page is mostly unreadable. Can't get anything out of it.
SlavikCA
·8 месяцев назад·discuss
Looks like Incus has no GUI?

Proxmox has nice web GUI
SlavikCA
·8 месяцев назад·discuss
Reading few blogs and forums about it today - people talking about switching to Gateway API (from "legacy" Ingress).

And I do not understand it:

1. Ingress still works, it's not deprecated.

2. There a lot of controllers, which supports both: Gateway API and Ingress (for example Traefik)

So, how Ingress Nginx retiring related / affects switch to Gateway API?
SlavikCA
·8 месяцев назад·discuss
And there is no profit, too.
SlavikCA
·8 месяцев назад·discuss
Google released MedGemma model: "optimized for medical text and image comprehension".

I use it. Found it to be helpful.
SlavikCA
·8 месяцев назад·discuss
I tried Talos few month ago. Found it unstable and complicated; reported few bugs.

And because they are "immutable" - I found it's significantly more complicated to use with no tangible benefits. I do not want to learn and deal declarative machine configs, learn how to create custom images with GPU drivers...

Quite a few things which I get done on Ubuntu / Debian under 60 seconds - takes me half an hour to figure out with Talos.