Click on "Listen to article", make sure the voice is "Umbriel" and skip to 4:15 - there's a hallucinated part at the end in Russian (I think). On a blog post about the latest and greatest AI model. Oh the irony.
This is not meant to replace Grafana, it actually calls into a Grafana instance to fetch dashboards and query data. It's just an alternative way to display the dashboards you already have in an existing Grafana instance.
It should handle the templating variables, at least from what I've tested on our dashboards. It gives you a list of available options just like in the Grafana UI. Try it out, once you select a dashboard you can press `v` and set the vars.
I can't say. It's definitely not the same as running on bare metal. Then again, any benchmark in a test environment is just an approximation of the real thing. To see how anything will act in the real environment, you have to run it there.
In our use case we wanted a way to quickly and easily set up benchmarks that would allow us to compare our software to our competitors under the same conditions. Given that Benchi can run the same benchmark scenario for different tools, the results are comparable with each other. We also run all benchmarks on an empty AWS EC2 instance, to minimize any other factors. But does that mean that the collected results show the absolute limit of what the tools can handle? Probably not. Under different conditions, results can change, but that's just the nature of benchmarks.