HackerTrans
TopNewTrendsCommentsPastAskShowJobs

carsonpoole

no profile record

Submissions

Comparing web search API providers on a Deep Research gauntlet

searchspace.io
2 points·by carsonpoole·18 hari yang lalu·0 comments

Web Search API for Agents 70x Cheaper Than Exa

searchspace.io
4 points·by carsonpoole·28 hari yang lalu·0 comments

Using a tiny GPT model to beat Brotli/ZSTD, 600x faster than Fabrice Bellard's

github.com
2 points·by carsonpoole·6 bulan yang lalu·0 comments

Nvidia GPU Specs and Pricing Cheatsheet

github.com
3 points·by carsonpoole·tahun lalu·1 comments

Free AI Audio Book Summaries

freeaibooksummaries.com
1 points·by carsonpoole·2 tahun yang lalu·0 comments

[untitled]

1 points·by carsonpoole·2 tahun yang lalu·0 comments

Show HN: FileFolder: AI File Manager: Auto Tag and Name and Vector Search

filefolder.org
8 points·by carsonpoole·2 tahun yang lalu·3 comments

Free Client Side Suite of Image/PDF Conversion and Resize and Compression

tools.filefolder.org
3 points·by carsonpoole·2 tahun yang lalu·0 comments

CUDA Utils – Simple CUDA utils/helpers for simplifying ND tensor memory access

github.com
3 points·by carsonpoole·2 tahun yang lalu·0 comments

150 LoC CUDA I8 Matmul That Beats CuBLAS Tensor Core FP16

github.com
1 points·by carsonpoole·2 tahun yang lalu·0 comments

Safetensors.cpp – Zero Dependency Safetensors Loading and Storing in C++

github.com
5 points·by carsonpoole·2 tahun yang lalu·0 comments

AI Receipt Tracker – AI takes your receipt photos and PDFs and extracts details

aireceipttracker.com
1 points·by carsonpoole·2 tahun yang lalu·0 comments

Free AI Chatbot – Locally Stored AI Chat, CSVs, Images, Claude, GPT4, Lots More

freeaichatbot.org
1 points·by carsonpoole·2 tahun yang lalu·0 comments

Local Only Embedding and Vector Search of 50k Web Pages from Fine Web

demo.haystack.zip
1 points·by carsonpoole·2 tahun yang lalu·1 comments

Haystack Embedded – 30x faster than FAISS, local first vector DB in pure Rust

github.com
2 points·by carsonpoole·2 tahun yang lalu·0 comments

Haystack DB – 10x faster than FAISS with binary embeddings by default

github.com
61 points·by carsonpoole·2 tahun yang lalu·26 comments

comments

carsonpoole
·2 tahun yang lalu·discuss
Thanks for the feedback! Do you think a dropbox-like setup with syncing some directory would suffice? or would it need to be completely offline?
carsonpoole
·2 tahun yang lalu·discuss
I wholeheartedly agree :) I've mostly put this together this weekend, so I haven't had time to do everything yet, but that's definitely on the todo list.

I FT'd some siglip models (see here: https://huggingface.co/carsonpoole/binary-siglip-text) that should be amenable to binary quantization so I'm going to tomorrow get an inference server running with that and then hopefully do the typical MTEB benchmarks for embeddings
carsonpoole
·2 tahun yang lalu·discuss
thank you for the kind words!
carsonpoole
·2 tahun yang lalu·discuss
not yet, but it's roughly linear at scaling, since it's a brute force algorithm. so with the current version it'd probably be about 22 seconds for a 1B vector search. the whole point of having metadata queries are to prevent those kind of searches from being necessary, and hopefully with some FTS interspersed it can reduce the number of similarity comparisons required even more
carsonpoole
·2 tahun yang lalu·discuss
IMO at least there are a lot of things that other vector DBs are missing and should exist. I want to make this work at petabyte scale data with the features on the readme's roadmap plus some others I have nebulous ideas about.
carsonpoole
·2 tahun yang lalu·discuss
It works right now, but I'm actively adding a lot of additional things that might make your life easier. The roadmap on the readme shows what I'm working on adding. Feel free to shoot me an email at carson at poole.ai and I'd be happy to give some guidance, but a quickstart is definitely at the top of my priorities also. :)