HackerTrans
TopNewTrendsCommentsPastAskShowJobs

DavidFerris

no profile record

Submissions

We rendered and embedded one million CAD files

cad-search-three.vercel.app
136 points·by DavidFerris·vor 5 Monaten·49 comments

comments

DavidFerris
·vor 5 Monaten·discuss
The initial ABC dataset is from public Onshape files -- clearly some people had a reason to design a dog model parametrically!
DavidFerris
·vor 5 Monaten·discuss
There's a pretty big bias for mechanical engineering components in the dataset- very few organic forms. It's one of the limitations we call out in the dataset card.

There are a few though! Try "dog" or "cookie cutter" for example.
DavidFerris
·vor 5 Monaten·discuss
This isn't meant to be a commercially useful search engine- just a demonstration. You'll only be able to search for terms that the VLM could directly discern.

From the blog post: Our search demo proves that it works quite well. As anticipated, text search works well, returning sensible results for even irregular or poorly formed queries. It’s worth mentioning that this is very different from 3D part libraries like Thingiverse or GrabCAD. Search in those repositories requires users to tag or annotate parts with a description, the text of which is used in search. Our system takes only an unnamed part as input, requiring no additional labelling.
DavidFerris
·vor 5 Monaten·discuss
We rendered the one million part ABC dataset from Deep Geometry, and open-sourced the data. We also built a fun demo with the following pipeline: CAD > render > caption > embed.

Open-sourced dataset: https://huggingface.co/datasets/daveferbear/3d-model-images-...

Blog writeup: https://www.finalrev.com/blog/embedding-one-million-3d-model...