Pandas with Rows (2022)(datapythonista.me)17 points·by fud101·7 mesi fa·1 commentsdatapythonista.mePandas with Rows (2022)https://datapythonista.me/blog/pandas-with-hundreds-of-millions-of-rows1 commentsPost comment[–]cjonas·6 mesi fareplySame query solved in duckdb instead (generated by claude). I wasn't able to run on the full dataset due to an encoding issue I didn't feel like solving... but with everything up until 2001, it returns seconds on my M4 MBP.https://gist.github.com/ChuckJonas/4ffb0743de0c20a61394a6b95...
https://gist.github.com/ChuckJonas/4ffb0743de0c20a61394a6b95...