They have millions of conversations with code prompts and diffs and the user telling them the model is taking a wrong turn. This is quite valuable data that is probably already used to tweak Kimi code (composer 2).
Moreover they have quite the enterprise client base that I suspect at least a portion of which will jump ship with the acquisition.
A reason not to run k8s is if you want your server to reach C10 idle states. The k8s control plain with its polling and checking are quite heavy on the mostly idle server.
I have reverted to just use Nixos and oci podman containers. Everything is declarative and reproducible
DevOps lost the plot with the Operator model. When it was being widely introduced as THE pattern I was dismayed. These operators abstract entirely complex services like databases behind yaml and custom go services. When going to kubecon i had one guy tell me he collects operators like candy. Answers on Lifecycle management, and inevitable large architectural changes in an ever changing operator landscape was handwaved away with series of staging and development clusters. This adds so much cost..
Fundamentally the issue is the abstractions being too much and entirely on the DevOps side of the "shared responsibility model".
Taking an RDBMS from AWS of Azure is so vastly superior to taking all that responsibility yourself in the cluster..
Meanwhile (being a bit of an infrastructure snob) I run Nixos with systemd oci containers at home. With AI this is the easiest to maintain ever.
Regarding GitHub actions and it's secret manager. Any decently organized company would do well to stay away from well known secret interfaces.
Instead use oidc auth to fetch secrets just in time, all short-lived for the duration of the pipeline.
This is referenced in a sci fi book "The dark forest" of the series "The 3 body problem". It sets a convincing narrative that because of time taken for observation and response and development speed of society it is most likely that all civilizations that announce themselves would likely be a threat in terms of technological supremacy eventually to observing civilizations. In other words, we don't hear anything because any sufficiently advanced civilization would not want to risk being discovered. I.e., the "dark silent forest".
I bought a Fujitsu Futron S920 second hand for like 30 euros. Put a dual NIC PCI in there and now have a low watt router running very fast. Can easily run 1Gbit up and down