Semantic Search for FAQs with Haystack(medium.com)
medium.com
Semantic Search for FAQs with Haystack
https://medium.com/deepset-ai/semantic-faq-search-with-haystack-6a03b1e13053
5 comments
Note that if you don't have access to a server with a GPU, don't bother with Haystack since most of their USP functionality requires a GPU -
and even that doesn't mean the queries will execute fast - expect double digit seconds per query. YMMV
Fair enough. That's the inherent 'feature' of the Transformer models, though. We have a series of articles on optimization here https://medium.com/deepset-ai/accelerate-your-qa-system-with... - but also, no, double digits seconds is not necessarily the best result :) Our users have done much better <g>
Yep, you want a GPU for many of the models. However, then subsecond queries are easy to achieve. See benchmarks: https://haystack.deepset.ai/benchmarks/latest
Not to be confused with http://haystackconf.com
Argh, yes. Didn't want to imply that.