Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet file format for tabular data #694

Open
cpalazzi opened this issue Oct 5, 2024 · 1 comment
Open

Parquet file format for tabular data #694

cpalazzi opened this issue Oct 5, 2024 · 1 comment

Comments

@cpalazzi
Copy link

cpalazzi commented Oct 5, 2024

What can be improved?

Parquet is a fast and highly compressible open source file type for tabular data. Compared to csvs it can save around 10x the storage space. It is already integrated with Pandas and Xarray so should be a very beneficial feature without too much to change.

Version

v0.6.10

@brynpickering
Copy link
Member

I don't believe that it is integrated into xarray, but certainly useful to consider for loading in with pandas.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants