HackerTrans
TopNewTrendsCommentsPastAskShowJobs

deivid

745 karmajoined 9 yıl önce
I have a computer-related blog at https://blog.davidv.dev/

You can contact me at [email protected]

Submissions

Revamping an Old TV as a Gift (2019)

blog.davidv.dev
74 points·by deivid·10 ay önce·33 comments

comments

deivid
·4 gün önce·discuss
I spent a day fiddling with AI and dropping the expensive layers in kokoro, on phones, on CPU, on MNN, it runs 3x faster.

Quality is very close.

Will vary in your setup, but here is my script: https://github.com/DavidVentura/translator-rs/blob/master/sc...
deivid
·17 gün önce·discuss
I am making (open) finetunes for malayalam and kannada (and bengali, gujarati, hebrew), and need someone to transcribe a few images for me. Could you contact me if you are interested in helping?
deivid
·geçen ay·discuss
Amazing! I'd recommend using PaddlePaddle OCR models if you want to make your handwriting conversion local, it's definitely fast enough. Probably faster than the Sonnet call.

I tried the model on your handwriting and it worked great. My handwriting is bad enough that it doesn't work :)
deivid
·2 ay önce·discuss
Commercial or FOSS? I've been researching the mobile side and it's very exciting!
deivid
·2 ay önce·discuss
Sounds great, but if you din't cave to apple/google (eg: graphene, lineage), models are not built-in. Every app needs to ship their own models, and they are not tiny.

Is there a solution for this? I'm currently just making users download onnx models if they want a feature, but it's not smooth UX
deivid
·2 ay önce·discuss
There's definitely a much smaller, cleaner kubernetes hiding inside the current monstrosity.

LB, Services, pods, DNS gets you like 99% of the way there
deivid
·2 ay önce·discuss
How do you manage to finish things? After a while, for me, the novelty high wears out, and instead it becomes a wall. Some project require something silly, like sending 1 email to be completed, and it becomes an impossible task
deivid
·2 ay önce·discuss
This captures a lot of how I've been feeling lately. Thanks for sharing
deivid
·3 ay önce·discuss
With this approach I managed to get to sub-10ms start (to pid1), if you can accept a few constraints there's plenty of room!

Though my version was only tested on Linux hosts
deivid
·3 ay önce·discuss
Have played it a few times, it's really good
deivid
·3 ay önce·discuss
Working (again) on an offline translator for Android: https://github.com/davidventura/offline-translator

This week I added TTS support, which needed multiple inference pipelines, it was not easy to find models for 50 languages!

At this point, it mostly works as a crude implementation of Google translate+Google lens, but 100% offline and 100% Google-free
deivid
·4 ay önce·discuss
Niiiiiice, I've been working on something like this, but reducing linux boot time instead of snapshot restore time; obviously my solution doesn't work for heavy runtimes
deivid
·4 ay önce·discuss
Says fast, but how fast? Didn't really see any measurements
deivid
·5 ay önce·discuss
TCC is fantastic! Very hackable, easy to compile to WASM for some interesting in-browser compilation
deivid
·6 ay önce·discuss
That makes sense, I guess this was not a problem for the times I needed nolibc.

I do agree that trying to extract data/logic from linux is a pain -- I've tried a few times to extract some of the eBPF verifier handling, but end up pulling most of the kernel along.
deivid
·6 ay önce·discuss
Unikraft is cool, I still have it in my 'todo' list to play around with sometime.

Linking the app with the 'kernel' seems pretty nice, would be cool to see what that looks like for a virtio-only environment.

Just wanted to point out that the 150ms is not snapshot based, you can get <10ms for small vms (128MB ram, 2GB ram moves you to ~15ms range), for 'cold' boots.
deivid
·6 ay önce·discuss
Would it be cheating to use the kernel's nolibc?
deivid
·6 ay önce·discuss
You can do <10ms. I was working to see if I could get it under 1ms, but my best was 3.5ms
deivid
·6 ay önce·discuss
You can boot a vm without snapshots in < 10ms, just need a minimal kernel.
deivid
·6 ay önce·discuss
This is really well written, thanks for sharing.

I didn't understand the point of using Unikraft though, if you can boot linux in much less than 150ms, with a far less exotic environment