HackerLangs
TopNewTrendsCommentsPastAskShowJobs

karimf

2,121 karmajoined vor 10 Jahren
https://fikrikarim.com

Submissions

Why WebRTC beats WebSockets for realtime voice AI

livekit.com
5 points·by karimf·vor 20 Tagen·0 comments

Unsloth Joins PyTorch Ecosystem

unsloth.ai
8 points·by karimf·vor 2 Monaten·2 comments

Denial of Service Vulnerability in React Server Components

github.com
2 points·by karimf·vor 2 Monaten·0 comments

Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

github.com
298 points·by karimf·vor 3 Monaten·38 comments

It's time to give back to the world

fikrikarim.com
2 points·by karimf·vor 3 Monaten·0 comments

Do your own writing

alexhwoods.com
748 points·by karimf·vor 3 Monaten·239 comments

Repose: Break reminder for macOS that pauses during meetings

github.com
2 points·by karimf·vor 3 Monaten·0 comments

Fully local voice AI on iPhone 15

fikrikarim.com
1 points·by karimf·vor 4 Monaten·2 comments

Cloudflare WAF proactively protects against React vulnerability

blog.cloudflare.com
2 points·by karimf·vor 7 Monaten·3 comments

Neural audio codecs: how to get audio into LLMs

kyutai.org
428 points·by karimf·vor 9 Monaten·119 comments

We Built a Chinese Typewriter [video]

youtube.com
7 points·by karimf·vor 9 Monaten·0 comments

comments

karimf
·vor 3 Tagen·discuss
This repo is a good starting point for comparing TTS models https://github.com/5uck1ess/tts-bench

Kokoro is a really good model, considered it’s released 1.5 years ago. It’s punching above its weight https://5uck1ess.github.io/tts-bench/scores.html
karimf
·letzten Monat·discuss
I've been using Zed for a few weeks now and these two are also my main complaints as well.
karimf
·vor 3 Monaten·discuss
Oh yeah for sure. At that point, using SES is probably a better option compared to running a VPS just for SMTP. I posted that to let them know that SMTP support is a requirement for some developers.
karimf
·vor 3 Monaten·discuss
Ok I just tried the service since I want to migrate from Resend.

Seems like you can only send email via the worker or REST API for now?

Can I send via SMTP? I'm using Supabase and it needs the SMTP credentials.

I can't find anything on the dashboard or on the docs, even though last year they said it supports SMTP [0]

[0] https://blog.cloudflare.com/email-service/
karimf
·vor 3 Monaten·discuss
Related: Gemma 4 on iPhone (254 comments) - https://news.ycombinator.com/item?id=47652561
karimf
·vor 3 Monaten·discuss
This is an interesting approach.

> How does this compare to Next.js App Router?

> Next.js App Router is server-first: your component tree lives on the server by default, and you opt into client interactivity with 'use client'.

> TanStack Start is isomorphic-first: your tree lives wherever makes sense. At the base level, RSC output can be fetched, cached, and rendered where it makes sense instead of owning the whole tree. When you want to go further, Composite Components let the client assemble the final tree instead of just accepting a server-owned one.

The sudden server-first change on Next.js App Router definitely trips some people, especially since React started as client-only library.
karimf
·vor 3 Monaten·discuss
Well, on my demo it's around 2.5s and I already consider it as a "real-time". One way to improve it is to disable the image input.
karimf
·vor 3 Monaten·discuss
What's your average response time with M1 max and what's the target?
karimf
·vor 3 Monaten·discuss
Is this the problem? https://news.ycombinator.com/item?id=47669954
karimf
·vor 3 Monaten·discuss
In the /r/macapps subreddit, they have huge influx of new apps posts, and the "whisper dictation" is one of the most saturated category. [0]

>“Compare” - This is the most important part. Apps in the most saturated categories (whisper dictation, clipboard managers, wallpaper apps, etc.) must clearly explain their differentiation from existing solutions.

https://www.reddit.com/r/macapps/comments/1r6d06r/new_post_r...
karimf
·vor 3 Monaten·discuss
During my limited testing, it works better than I expected at handling multiple languages in a single session. Perhaps I just had a low expectation since I've mostly worked with English-only STT models.
karimf
·vor 3 Monaten·discuss
Nothing unique, it's just taking a snapshot when it's processing the input. Even processing a single image will increase the TTFT by ~0.5s on my machine, so for now, it seems to be impossible for feeding a live video and expecting a real-time response.

In regards to the video capability, I haven't tested it myself, but here's a benchmark/comparison from Google [0]

[0] https://huggingface.co/blog/gemma4#video-understanding
karimf
·vor 3 Monaten·discuss
Huh that's weird. I just tried it and it works on my machine. Could you perhaps create a GitHub issue and share the reproduction steps and any relevant logs?
karimf
·vor 3 Monaten·discuss
This. I posted this on my other comment, but there's a meme that "Gen Z Kids Don't Understand How File Systems Work" [0].

There seems to be a disconnect between some developers and the younger folks.

[0] https://news.ycombinator.com/item?id=30253526
karimf
·vor 3 Monaten·discuss
This is my stance as well, but keep in mind that a lot of people have the opposite preference.

They didn't grow up with the world wide web. They only started using technology when Android and iPhone was popular. They only know Whatsapp, Youtube, TikTok. They're not used to using the browser.

There's a meme that "Gen Z Kids Don't Understand How File Systems Work" [0]

So, it'll depend on your target audiences.

[0] https://news.ycombinator.com/item?id=30253526
karimf
·vor 3 Monaten·discuss
Oh wow, that's awesome. Thanks a lot, dang!
karimf
·vor 3 Monaten·discuss
Thank you. This reminds me of a paragraph from the LatentSpace newsletter [0]

> The excellent on device capabilities makes one wonder if these are the basis for the models that will be deployed in New Siri under the deal with Apple….

https://www.latent.space/p/ainews-gemma-4-the-best-small-mul...
karimf
·vor 3 Monaten·discuss
Thanks for sharing! I'm still torn about it. Sure it'll feel more natural if you have the AI head animation, but I don't want people to get attached to it. I don't want to make the loneliness epidemic even worse.
karimf
·vor 3 Monaten·discuss
Thanks! Although, I can't claim any credit for it. I just spent a day gluing what other people have built. Huge props to the Gemma team for building an amazing model and also an inference engine that's focused for edge devices [0]

[0] https://github.com/google-ai-edge/LiteRT-LM
karimf
·vor 3 Monaten·discuss
This app is cool and it showcases some use cases, but it still undersells what the E2B model can do.

I just made a real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B. I posted it on /r/LocalLLaMA a few hours ago and it's gaining some traction [0]. Here's the repo [1]

I'm running it on a Macbook instead of an iPhone, but based on the benchmark here [2], you should be able to run the same thing on an iPhone 17 Pro.

[0] https://www.reddit.com/r/LocalLLaMA/comments/1sda3r6/realtim...

[1] https://github.com/fikrikarim/parlor

[2] https://huggingface.co/litert-community/gemma-4-E2B-it-liter...