Running it fully locally isn't easy because you need a complex setup with GPUs. Can you give some more color on exactly what you are trying to do (number of PDFs, types of queries, etc.)? With some more info we can give you some guidance.
Hi. I'm one of the people on this project with dsubburam (who started this thread). Thx for the question. Can you email one of us about this (emails in bios)? We're building the feature you are asking for here.