Another positive case of using ChatGPT! It is not good at math but it's good at the dirty work that you need before you start calculating. That's how you use it to make life easier!
"Our old data warehouse consisted of the most popular components of the time, including Apache Hive, MySQL, Elasticsearch, and PostgreSQL. They support the data computing and data storage layers of our data warehouse."
"As you can imagine, a long and complicated data pipeline is high maintenance and detrimental to development efficiency."
Maybe a little off-topic here, but if they use Twitter and Reddit as datasets to train their LLMs, how can they guarantee that the AI models will be unbiased. Prejudice, hatred, and ill intentions can all be very delicate to identify.
According to the post, the whole system costs half a million pounds, but perhaps it forgot to mention how long the system can last. If it can be used long enough, that it wouldn't matter how expensive it is to build, it will be the most environmentally friendly product in the world, like subways.
Apache Doris claims to be over 10 times faster than ClickHouse in keyword searches. The link in the tweet points to a technical writeup that explains the work they done to achieve that. Inverted index was included in ClickHouse as a new feature a few months ago.
If you'd like to learn more use cases about Apache Doris, you may read our user stories (https://doris.apache.org/blog?currentPage=1¤tCategory=...) or join our community on Slack (https://join.slack.com/t/apachedoriscommunity/shared_invite/...)
And this is a functional comparison between Apache Doris and Redshift: https://drive.google.com/file/d/1brUjcu_Lgisy4oa-g9hNvktz0ca...