HackerTrans
トップ新着トレンドコメント過去質問紹介求人

zyoralabs

no profile record

投稿

Student Entrepreneur Program by Zyorabyte – Help students to build their starup

zyorabyte.org
1 ポイント·投稿者 zyoralabs·3 か月前·0 コメント

[untitled]

1 ポイント·投稿者 zyoralabs·3 か月前·0 コメント

[untitled]

1 ポイント·投稿者 zyoralabs·3 か月前·0 コメント

[untitled]

1 ポイント·投稿者 zyoralabs·4 か月前·0 コメント

Show HN: QLoRA fine-tuning in .zse INT4 format by ZSE

1 ポイント·投稿者 zyoralabs·4 か月前·0 コメント

Show HN: ZSE – Single-file LLM engine with dual INT4 kernels

github.com
1 ポイント·投稿者 zyoralabs·4 か月前·0 コメント

Show HN: ZSE – Open-source LLM inference engine with 3.9s cold starts

github.com
58 ポイント·投稿者 zyoralabs·5 か月前·9 コメント

コメント

zyoralabs
·3 か月前·議論
Python-to-Metal kernel compiler for Apple Silicon. You write GPU kernels as decorated Python functions — locomp compiles them through an SSA intermediate representation to native Metal Shading Language, optimizes them (CSE, DCE, constant folding), and dispatches on your Apple GPU.

Think Triton, but for Apple Silicon.

It supports the full kernel programming model: SIMD reductions, shared memory, atomics, simdgroup matrix ops (AMX hardware), auto-tuning, float16, INT4/INT8 quantization. 54 working examples including Flash Attention v1/v2/v3, paged attention, RoPE, SwiGLU.

As a proof of concept — SmolLM2-135M runs end-to-end on locomp kernels. No PyTorch, no MLX, no Metal C++. Just @locomp.kernel Python.

pip install locomp