HackerTrans
TopNewTrendsCommentsPastAskShowJobs

carsonpoole

no profile record

Submissions

Comparing web search API providers on a Deep Research gauntlet

searchspace.io
2 points·by carsonpoole·18 วันที่ผ่านมา·0 comments

Web Search API for Agents 70x Cheaper Than Exa

searchspace.io
4 points·by carsonpoole·28 วันที่ผ่านมา·0 comments

Using a tiny GPT model to beat Brotli/ZSTD, 600x faster than Fabrice Bellard's

github.com
2 points·by carsonpoole·6 เดือนที่ผ่านมา·0 comments

Nvidia GPU Specs and Pricing Cheatsheet

github.com
3 points·by carsonpoole·ปีที่แล้ว·1 comments

Free AI Audio Book Summaries

freeaibooksummaries.com
1 points·by carsonpoole·2 ปีที่แล้ว·0 comments

[untitled]

1 points·by carsonpoole·2 ปีที่แล้ว·0 comments

Show HN: FileFolder: AI File Manager: Auto Tag and Name and Vector Search

filefolder.org
8 points·by carsonpoole·2 ปีที่แล้ว·3 comments

Free Client Side Suite of Image/PDF Conversion and Resize and Compression

tools.filefolder.org
3 points·by carsonpoole·2 ปีที่แล้ว·0 comments

CUDA Utils – Simple CUDA utils/helpers for simplifying ND tensor memory access

github.com
3 points·by carsonpoole·2 ปีที่แล้ว·0 comments

150 LoC CUDA I8 Matmul That Beats CuBLAS Tensor Core FP16

github.com
1 points·by carsonpoole·2 ปีที่แล้ว·0 comments

Safetensors.cpp – Zero Dependency Safetensors Loading and Storing in C++

github.com
5 points·by carsonpoole·2 ปีที่แล้ว·0 comments

AI Receipt Tracker – AI takes your receipt photos and PDFs and extracts details

aireceipttracker.com
1 points·by carsonpoole·2 ปีที่แล้ว·0 comments

Free AI Chatbot – Locally Stored AI Chat, CSVs, Images, Claude, GPT4, Lots More

freeaichatbot.org
1 points·by carsonpoole·2 ปีที่แล้ว·0 comments

Local Only Embedding and Vector Search of 50k Web Pages from Fine Web

demo.haystack.zip
1 points·by carsonpoole·2 ปีที่แล้ว·1 comments

Haystack Embedded – 30x faster than FAISS, local first vector DB in pure Rust

github.com
2 points·by carsonpoole·2 ปีที่แล้ว·0 comments

Haystack DB – 10x faster than FAISS with binary embeddings by default

github.com
61 points·by carsonpoole·2 ปีที่แล้ว·26 comments

comments

carsonpoole
·2 ปีที่แล้ว·discuss
Thanks for the feedback! Do you think a dropbox-like setup with syncing some directory would suffice? or would it need to be completely offline?
carsonpoole
·2 ปีที่แล้ว·discuss
I wholeheartedly agree :) I've mostly put this together this weekend, so I haven't had time to do everything yet, but that's definitely on the todo list.

I FT'd some siglip models (see here: https://huggingface.co/carsonpoole/binary-siglip-text) that should be amenable to binary quantization so I'm going to tomorrow get an inference server running with that and then hopefully do the typical MTEB benchmarks for embeddings
carsonpoole
·2 ปีที่แล้ว·discuss
thank you for the kind words!
carsonpoole
·2 ปีที่แล้ว·discuss
not yet, but it's roughly linear at scaling, since it's a brute force algorithm. so with the current version it'd probably be about 22 seconds for a 1B vector search. the whole point of having metadata queries are to prevent those kind of searches from being necessary, and hopefully with some FTS interspersed it can reduce the number of similarity comparisons required even more
carsonpoole
·2 ปีที่แล้ว·discuss
IMO at least there are a lot of things that other vector DBs are missing and should exist. I want to make this work at petabyte scale data with the features on the readme's roadmap plus some others I have nebulous ideas about.
carsonpoole
·2 ปีที่แล้ว·discuss
It works right now, but I'm actively adding a lot of additional things that might make your life easier. The roadmap on the readme shows what I'm working on adding. Feel free to shoot me an email at carson at poole.ai and I'd be happy to give some guidance, but a quickstart is definitely at the top of my priorities also. :)