HackerTrans
トップ新着トレンドコメント過去質問紹介求人

noahkay13

no profile record

投稿

Parakeet.cpp – Parakeet ASR inference in pure C++ with Metal GPU acceleration

github.com
114 ポイント·投稿者 noahkay13·4 か月前·31 コメント

Show HN: Axiom – C++ tensor library with NumPys API, optimized for Apple Silicon

github.com
3 ポイント·投稿者 noahkay13·5 か月前·2 コメント

Show HN: Axiom – C++ tensor library with NumPy API and Metal GPU support

5 ポイント·投稿者 noahkay13·5 か月前·0 コメント

コメント

noahkay13
·4 か月前·議論
The CoreML backend is WIP in Axiom and will roll over to parakeet.cpp when it's ready, the same with CUDA. FluidAudio is a great option for those building Mac-only apps, but the goal with Axiom and Parakeet.cpp is to be very portable and embeddable into almost any app. I will write C and Swift wrappers shortly, then if it's really wanted, a Python wrapper.
noahkay13
·4 か月前·議論
On macbook pro - parakeet.cpp is very low latency, under 100ms (76ms) for 60s audio.
noahkay13
·4 か月前·議論
Theoretically, yes? This hasent been tested but xcode has great c++ interop and the goal with Axiom and now parakeet.cpp is to be used for portable deployments so making that process easier is definitely on the roadmap.
noahkay13
·4 か月前·議論
I built a C++ inference engine for NVIDIA's Parakeet speech recognition models using Axiom(https://github.com/Frikallo/axiom) my tensor library.

What it does: - Runs 7 model families: offline transcription (CTC, RNNT, TDT, TDT-CTC), streaming (EOU, Nemotron), and speaker diarization (Sortformer) - Word-level timestamps - Streaming transcription from microphone input - Speaker diarization detecting up to 4 speakers
noahkay13
·5 か月前·議論
I appreciate the advice. Right now, numerical coverage, absolute performance, and DX are my biggest priorities. Looking to get traction from OSS so scope creep doesn't catch up to me and some passionate devs can jump on board, autograd and CUDA are the next really big milestones for Axiom.