HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jtarchie

no profile record

Submissions

Yet Another SQLite-Vector

github.com
1 points·by jtarchie·4 เดือนที่ผ่านมา·1 comments

comments

jtarchie
·4 เดือนที่ผ่านมา·discuss
sqlite extension that uses database tables for indexing HNSW values. This is something I wanted to build after trying to build my own in pure Go.

Warning: Was vibe coded with my instructions of architecture, testing preferences (LuaJIT for FFI), and how I wanted to be able to accept stories.
jtarchie
·9 เดือนที่ผ่านมา·discuss
ncruces helped me with some code I made for VFS. It uses [zstd seekable](https://github.com/jtarchie/sqlitezstd) for reading a file. I thought it would be really well-suited for S3.

- Support for HTTP range queries - "Fast" read times - No disk required

I was wrong.

It turns out that for specific SQL queries, it might be fine, but not fast. For queries that do aggregations, like `COUNT`, sqlite loads the whole database anyway.