My Battle with Datetimes in Prod(datacompose.io)

5 pointsby tccole7 เดือนที่ผ่านมา2 comments

https://www.datacompose.io/blog/fun-with-datetimes

2 comments

abstractspoon7 เดือนที่ผ่านมา

>> Date inference is genuinely hard—there’s no universal standard

Umm, ISO is the universal standard

tccole7 เดือนที่ผ่านมา

I spent 8 hours debugging datetime parsing in a PySpark migration. Every solution failed… built-in functions returned silent NULLs, UDFs took 6 hours to run, pandas UDFs still failed on 8% of rows.