In this blog post, we will be covering how you can combine and leverage the open-source streaming solution, bytewax, with ydata-profiling, to improve the quality of your streaming flows. Buckle up!
A hands-on tutorial covering how you can combine and leverage the open-source streaming solution, bytewax, with ydata-profiling, to improve the quality of your streaming flows!
Data Quality is key for all applications and models, and LLMs are no exception :) I've been working on a small community project with synthetic data (https://github.com/ydataai/ydata-synthetic) using ydata-synthetic, and it really shows! Underrepresentation (category imbalance) and missing data are two of the main issues!
At the Data-Centric AI Community, we have started a project around synthetic data (https://github.com/Data-Centric-AI-Community/nist-crc-2023)
It's a beginner-friendly, low-pressure project that everyone can add to their portfolios so the goal is really to learn more about the topic and experiment. We're looking to have more contributors to the project and this Thursday we're actually having a short "code with me" session for those who would like to follow the project as well, hopefully, you can start coding with us too :)
We've been recently at the Dask Demo Day and we're hoping to launch a new feature on ydata-profiling, with the support for Dask dataframes!
We're looking for Dask Wizards to start collaborating on this feature, so if you're interested, please join us to define the roadmap of the project and start making it real
Hey everyone, if you're looking for a friendly space to start your machine learning and data science journey, come and join us at the Data-Centric AI Community! We currently have a project open on Synthetic Data Generation, and we're looking for more contributors!