We built a software (Botium Box - https://botium.ai) mainly for On-Premise use, and we delivered as Kubernetes, Openshift, Docker. We added a hosted plan later and thought it would be a good idea to just use managed Kubernetes for this offer as it didn't require much coding changes.
We have to support multiple clouds (Azure and AWS), but with Rancher, it is really easy in usage - setting up new clusters, deploying new services, restarting, logging etc. But now that we built up container technology know-how we are transitioning every service where we don't need the scaling capabilities of Kubernetes to plain old docker-compose on baremetal.
Thanks for the interesting article, didn't know about Nomad and will try it for sure.
sure, that's a good point. and scaling a one-node-cluster to a multi-node-cluster is also nearly no effort on AWS. but for the topics where we can predict the computing power for the next months, we migrated everything to baremetal.
fully agree - that's how we started - getting some servers up and running is quick and easy, but as soon as you can foresee what computer power you will need in the next months and years, baremetal is surely the better choice. If you can deal with the technical stuff, of course.
nobody asks how to make money if you already have a hell lot of money and a growth rate like clubhouse. there is plenty of venture money available, more that can be spent.
After several months of beta test we now published Botium Speech Processing version 1.0.0.
It was proven to work in several client-specific speech processing tasks, mainly related to automated testing of voice interfaces.
Recently we had to evaluate if chatbot we built for an Austrian telecommunication provider would perform better on other NLP engines than the one we had in use (a cloud-based one). We took the training data and calculated common performance metrics, confusion matrices and accuracy scores for a bunch of the blockbuster providers (IBM Watson, Google Dialogflow, Amazon Lex, Microsoft LUIS, Rasa and some more).
Few years ago, when building a chatbot for an Austrian telecommunication provider, we noticed that none of the available test automation frameworks was really helping us in testing and training. So we started to build something from scratch, published it on Github, gave it the name "Botium" (Selenium for Websites, Appium for Apps, Botium for Bots ...), and 50k awesome developers downloaded it.
We gave it a pluggable architecture to work with all relevant Conversational AI and NLP/NLU providers out there, made it DevOps- and TestOps-friendly with a CLI and bindings to most loved test runners out there (Mocha, Jest, Jasmine, ...), and still the whole stack is Open Source on Github - thanks to our awesome community and cooperations with ISVs.
Curious to hear your thoughts on the topic - clearly, testing a Conversational AI holds some special challenges for you in regards of test coverage and test levels (API vs E2E).
https://github.com/watson-developer-cloud/assistant-simple/c...