Our design is parallelized, runs efficiently on multi-core cloud servers and
scales horizontally with the addition of app servers. Our DB is, for the most
part, used for caching and configuration, so it's generally not an issue.
We currently use Spacy Large English Core Model, we've experimented w/ others. We can store our meta data in many of the DBs supported by Django. We have a number of deployments on Postgres. We can also support Searching SQL DBs Using a flexible query template.