Pandas with Rows (2022)(datapythonista.me)

17 ポイント投稿者 fud1017 か月前1 コメント

Pandas with Rows (2022)

https://datapythonista.me/blog/pandas-with-hundreds-of-millions-of-rows

1 コメント

cjonas6 か月前

Same query solved in duckdb instead (generated by claude). I wasn't able to run on the full dataset due to an encoding issue I didn't feel like solving... but with everything up until 2001, it returns seconds on my M4 MBP.

https://gist.github.com/ChuckJonas/4ffb0743de0c20a61394a6b95...