Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

CSVs are bad. If you can change the format then don't use a DSV, use parquet and a library for your language to consume parquet.

It's less code for you and you can do neat things like zstd compression on the columns.

Bonus, it also doesn't require that you load and unload everything in memory.

https://arrow.apache.org/docs/python/parquet.html



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: