Function calling is a great feature. I've been using LLMs for function calls for the past few months and gpt-4 has worked great for this out of the box. Awesome to see both the models specifically trained for this.
The inference seems to be taking very long and it gets stuck at times forever (> a few minutes). My guess is that this is happening due to the load? How fast is this when it's not under load? Is it as fast as ChatGPT?