HackerTrans
TopNewTrendsCommentsPastAskShowJobs

sonium

no profile record

comments

sonium
·11개월 전·discuss
TLDR: There are two versions of the Parquet file format, but adoption of Version 2 is slow due to limited compatibility in major engines and tools. While Version 2 offers improvements (smaller file sizes, faster write/read times), these gains are modest, and ecosystem support remains fragmented. If full control over the data pipeline is possible, using Version 2 can be worthwhile; otherwise, compatibility concerns with third-party integrations may outweigh the benefits. Parquet remains dominant, and its utility far surpasses these challenges
sonium
·작년·discuss
Or you simply use the pytorch.powerplant_no_blow_up operator [1]

[1] https://www.youtube.com/watch?v=vXsT6lBf0X4
sonium
·작년·discuss
But I still need pip to install uv, right? Or download it using a one-liner alternatively.