Really cool to see people already testing the capabilities of OpenAI's latest release. Not sure how useful this will be in practice since it will likely lack business context/tribal knowledge, but still really interesting.
Open source LLMs are catching up with OpenAI. They are also considerably cheaper in the long run. We took a look at how they performed in terms of accuracy vs. OpenAI in an NL-to-SQL workload.
tldr -> For zero-shot prompting, the closed source LLMs are still far ahead in terms of generating accurate SQL. However the gap is closing. With the right dataset for fine-tuning the open-source LLMs might be able to perform at the same level.
That's absolutely fascinating! The use of single-molecule fluorescence to verify rotational motion is indeed impressive. I'm curious, how do you think this groundbreaking technique could potentially impact future research in the field?
seems like there's a high potential for the AI to hallucinate and get confused with ingredient measurements... last I checked, LLMs struggle with numbers.