daemonologist

2,440 karmajoined 3 anni fa

knç[email protected] (remove the cedilla from the 'c')

Submissions

PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Compact VLM

13 pointsby daemonologist9 mesi fa3 comments

The first interstellar software update: The hack that saved Voyager 1 [video]

108 pointsby daemonologist9 mesi fa24 comments

comments

There was a fad a while back of building insanely long prompts - tens of thousands of tokens - including having models write prompts for themselves. I always thought it was counterproductive, especially if you're going to use the prompt more than a couple of times. (That said, the e.g. Claude Code system prompt is insanely long, so if you genuinely have a lot of information to provide maybe it's beneficial. Like, shorter is better, but you don't want to be under-specified.)

l’altro ieridiscuss

I think they're saying that you should build a small business which nets you 85k, not find an employer that underpays you.

(Whether this makes you more resistant to being "fired" is still up for debate of course.)

l’altro ieridiscuss

It goes up - quite a lot - if you take promotions.

But, back in the day FIRE used to mean something beyond just being rich - there was an anti-consumerist bent (and expectation that you'd move away from your expensive city/former job) that usually went along with lower spending.

l’altro ieridiscuss

Only if you seek them out (ski resorts and such). I've lived in both of the most expensive major inland cities (Chicago and Denver) and $85k is plenty in both, even for a small family.

11 giorni fadiscuss

A 7900 XTX is about $850, and the rest of the computer basically just needs to boot Linux. You could easily build such a machine for $1500.

Even that isn't strictly necessary - you can get perfectly acceptable performance by splitting a model between multiple older 12 or 16 GB cards.

12 giorni fadiscuss

I would definitely not recommend WordPress.

If you just want a website for cheap: Bearblog, carrd.co, etc.

if you want all the bells and whistles on a platter: Squarespace, Wix, etc.

if you want to supply all the HTML/CSS yourself: Github Pages or Cloudflare Pages.

(Later, if you want to host the above (except the "bells and whistles" tier) yourself: Hetzner, Digital Ocean, etc.)

13 giorni fadiscuss

Interesting that many of them lead with clams or oysters. (Perhaps this is still a thing at high-end restaurants, but to have them listed so frequently and prominently is completely foreign to me.)

16 giorni fadiscuss

Proof of what is possible with stripped down/optimized software. Imagine the battery life if they built one of these around something with better sleep power (e.g. an nrf52).

17 giorni fadiscuss

Ha, developers know perfectly well how to choose models - they know that the company is footing the bill and Opus will give them the best result and/or require the least clean-up work.

(We've received similar guidance. Even better is that our provider, GitHub Copilot, does not provide usage information to individual users if there is no per-user budget configured. So we just fire our requests into the black box and at the end of the month when IT gets the bill we maybe get a talking-to if it's excessive.)

17 giorni fadiscuss

Only Florida, Maryland, and New York require adults who are new drivers to take any kind of class/instruction. (Most states require it under 18, with a few under 21 or 25.) Everywhere else you can just walk in and take the test.

The perhaps greater problem though is that those tests are completely trivial.

18 giorni fadiscuss

Yes you can connect keyboard and mouse; Overwatch (https://www.protondb.com/app/2357570) and WoW (https://appdb.winehq.org/objectManager.php?sClass=version&iI...) should both work well, as do the vast majority of single-player games. Some multiplayer games with particularly invasive anti-cheat may not, so if you have anything else in mind best to check before buying.

20 giorni fadiscuss

I like that it involves grinding up the tick. Just deserts.

22 giorni fadiscuss

No. I feel the same way, and have started moving to only do hardware-focused side projects. (I would say this works out nicely because I had several ideas on standby, but their cost has gone up 3-4x due to current memory and storage prices, which is I guess sort of depressingly poetic.)

22 giorni fadiscuss

At some point in late 2017 the paper was updated with this additional detail:

    Equal contribution. Listing order is random. Jakob proposed replacing RNNs with self-attention and started the effort to evaluate this idea. Ashish, with Illia, designed and implemented the first Transformer models and has been crucially involved in every aspect of this work. Noam proposed scaled dot-product attention, multi-head attention and the parameter-free position representation and became the other person involved in nearly every detail. Niki designed, implemented, tuned and evaluated countless model variants in our original codebase and tensor2tensor. Llion also experimented with novel model variants, was responsible for our initial codebase, and efficient inference and visualizations. Lukasz and Aidan spent countless long days designing various parts of and implementing tensor2tensor, replacing our earlier codebase, greatly improving results and massively accelerating our research.

In any case, if the authors considered their contributions equal, that's good enough for me.

24 giorni fadiscuss

The benefit of running the full precision version is negligible (probably not even measurable above the benchmark noise floor). Most common for cost-conscious users is to run something around 4-6 bits per weight, which would fit on a 24 or 32 GB card (as you mentioned).

25 giorni fadiscuss

There is no "coder" version of Qwen 3.6; I think they just mean it's a coding-focused model of similar size and performance (to Qwen 3.6 35B-A3B).

Regular Qwen 3.6 benchmarks slightly better and has much wider software support though, so this is probably of interest only to organizations which disallow models trained in China.

26 giorni fadiscuss

The allegation here is that it's not actually a fine-tune of Qwen, but instead an undisclosed mashup (merge) of someone else's fine-tune of Qwen and the original model. Rio subsequently said that the model was in fact a merge, that they did additional fine-tuning after the merge, and that they accidentally uploaded the base merge instead of the version with additional fine-tuning. But this seems like quite an oversight...

27 giorni fadiscuss

There are also significant economies of scale (namely: utilization and batching), which tend to make inference on a shared server more economical even after the operator takes a cut.

28 giorni fadiscuss

You can bounce the ball up slightly (presumably the spin from rolling is modeled or approximated, and gives lift when hitting a bumper), which might be enough to skip from the tee to near the end of the course. Not sure that should be considered for "par" though. Took me 14.

29 giorni fadiscuss

Opus 4.7 and 4.8 are also rather "proactive" - several times I've seen them try to inspect compiled binaries before there's even a problem, just to check that their changes are included (and if I let them do so they often get stuck down that rabbithole).