HackerTrans
TopNewTrendsCommentsPastAskShowJobs

zcbenz

no profile record

Submissions

Show HN: You need a few lines of JS, not a vector database

github.com
5 points·by zcbenz·2 ปีที่แล้ว·3 comments

Show HN: Chrohime – cross-platform C library wrapping Chromium's native UI code

github.com
2 points·by zcbenz·2 ปีที่แล้ว·0 comments

Show HN: Sisi – Semantic Image Search CLI tool, locally without third party APIs

github.com
128 points·by zcbenz·2 ปีที่แล้ว·41 comments

V8 is damn fast, faster than C++ when it comes to numerics

github.com
1 points·by zcbenz·2 ปีที่แล้ว·1 comments

V8 is damn fast, faster than C++ when it comes to numerics

twitter.com
8 points·by zcbenz·2 ปีที่แล้ว·1 comments

Show HN: Train a language model from scratch with JavaScript

github.com
1 points·by zcbenz·2 ปีที่แล้ว·0 comments

Show HN: node-mlx – Machine learning framework for Node.js

github.com
2 points·by zcbenz·2 ปีที่แล้ว·0 comments

JavaScript's garbage collector is not very ready for machine learning

github.com
9 points·by zcbenz·2 ปีที่แล้ว·2 comments

Show HN: Inference Llama2 with High-Level C++

github.com
1 points·by zcbenz·2 ปีที่แล้ว·0 comments

Show HN: Chie – a cross-platform, native, and extensible desktop client for LLMs

chie.app
67 points·by zcbenz·3 ปีที่แล้ว·23 comments

comments

zcbenz
·5 เดือนที่ผ่านมา·discuss
It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083
zcbenz
·ปีที่แล้ว·discuss
In the absence of hardware unified memory, CUDA will automatically copy data between CPU/GPU when there are page faults.
zcbenz
·ปีที่แล้ว·discuss
Most features are already supported on x86 CPUs, you can pip install mlx on Linux , and you can even use it on Windows (no official binary release yet but it is building and tests are passing).
zcbenz
·ปีที่แล้ว·discuss
For learning internals of ML frameworks I recommend reading the source code of MLX: https://github.com/ml-explore/mlx .

It is a modern and clean codebase without legacies, and I could understand most things without seeking external articles.
zcbenz
·2 ปีที่แล้ว·discuss
You can use any serialization that supports numbers, in the repo I used BSER (a binary format of JSON), you can even use raw JSON but it would be very inefficient for float numbers though.
zcbenz
·2 ปีที่แล้ว·discuss
No it is not normal, I only tested x64/arm64 macs, I will try on linux.
zcbenz
·2 ปีที่แล้ว·discuss
That is sad, the name sisi comes from the sisi empress: https://en.m.wikipedia.org/wiki/Empress_Elisabeth_of_Austria
zcbenz
·2 ปีที่แล้ว·discuss
A few months ago I ported ~15k lines of python code (10k are tests) to typescript, using GPT4. It cost me ~$70.

The python project is https://github.com/ml-explore/mlx and the converted project is https://github.com/frost-beta/node-mlx

I wrote a long prompt: https://github.com/frost-beta/node-mlx/blob/main/tests/promp...

The first result was almost always bad, but after manually modifying the assistant's answer, following generation usually went much better.
zcbenz
·2 ปีที่แล้ว·discuss
I wrote a Node.js module that implemented similar feature years ago. https://github.com/atom-archive/node-runas (An updated fork can be found at https://www.npmjs.com/package/runas-redux)
zcbenz
·3 ปีที่แล้ว·discuss
Shameless to insert my app here, also open source and provides quick access from menu bar.

https://chie.app/posts/minimalist-approach-to-using-chatgpt/
zcbenz
·3 ปีที่แล้ว·discuss
I would argue it is not a large part a webview. The webview related code is 900 lines vs the whole project 10k lines.
zcbenz
·3 ปีที่แล้ว·discuss
I actually asked ChatGPT what chie might mean in other languages, for multiple times, but it did not tell me this :(