This repository has been archived by the owner on Feb 18, 2024. It is now read-only.
v0.12.0
A new version of arrow2 is now available in crates.io. 🎉🎉🎉
See below all great things that were released 🚀. But before that, thank you so much to everyone that contributed to this release: 🙇
@ahmedriza, @dexterduck, @GPSnoopy, @HaoYang670, @SimonSchneider, @TurnOfACard, @aptr322, @arxra, @b41sh, @cjermain, @dbr, @jorgecarleitao, @ritchie46
Breaking changes:
- Require one encoding per parquet column on write #1012
- Bumped parquet2 #1035 (jorgecarleitao)
- Improved performance of deserializing JSON (2x) #1024 (jorgecarleitao)
- Remove
from_trusted_len_*
fromBuffer
#1020 (jorgecarleitao) - Bumped arrow-format #1011 (jorgecarleitao)
- Replace
fn Offset::is_large()
asconst Offset::IS_LARGE
#1002 (HaoYang670) - Renamed
ArrowError
toError
#993 (jorgecarleitao)
New features:
- Added support to deserialize
MapArray
from parquet #1045 (jorgecarleitao) - Added support for random access reads from IPC #1034 (jorgecarleitao)
- Added support for custom sort
build_compare_fn
#1016 (b41sh) - Added support to write nested parquet #1007 (jorgecarleitao)
- Added support for deserializing JSON from iterator #989 (cjermain)
Fixed bugs:
- Writing of
ListArray
does not preserve all values #1008 - Write a two-dimensional list to parquet file failed #992
- Writing to Parquet fails for extension types that contain lists #830
- Fixed using lower limit than size of first parquet row group #1046 (arxra)
- Fixed error in consuming sliced
FixedSizedBinary
from c data interface (FFI) #1026 (jorgecarleitao) - Fixed lexsort limit equal or greater than row_count #1021 (b41sh)
- Fixed error in reading nested parquet structs #1015 (jorgecarleitao)
- Fixed panic on debug print of invalid timezones #1013 (jorgecarleitao)
- Treat empty timezone string as no-timezone #1009 (dbr)
- Fixed encoding of
NaN
to json #990 (SimonSchneider) - Fixed error in writing
ListArray
to parquet #984 (jorgecarleitao) - Fixed decoding Binary Plain pages with dictionary pages #982 (aptr322)
Enhancements:
- Added
Debug
andPartialEq
forMapArray
#1043 (jorgecarleitao) - Exposed compression levels for parquet #1041 (ritchie46)
- Added
.arced
/.boxed
to arrays #1040 (jorgecarleitao) - Added utility to create encodings #1018 (jorgecarleitao)
- Made
parquet_to_arrow_schema
public #1006 (martingallagher) - Speeded up
min_max_boolean
for the case where all values are null #1005 (HaoYang670) - Simplified
min_max_string
andmin_max_binary
#1004 (HaoYang670) - Added support for Decimal in
build_compare
#998 (GPSnoopy) - remove accidental quadratic null_count #991 (ritchie46)
- Aligns MutableDictionaryArray's with MutablePrimitiveArrays with TryPush #981 (TurnOfACard)
Documentation updates:
- Cleaned docs for BinaryArray #1047 (jorgecarleitao)
- Improved API docs for
MutableBitmap
#1025 (jorgecarleitao) - Improved docs for
bitmap
#1022 (jorgecarleitao) - Improved API docs for
PrimitiveArray
andUtf8Array
#1017 (jorgecarleitao) - Fixed dev guide #1003 (jorgecarleitao)
Testing updates:
- Added more tests #1029 (jorgecarleitao)
- Moved coverage reporting to
cargo-llvm-cov
#1028 (jorgecarleitao) - Added more tests (increase coverage) #1027 (jorgecarleitao)
- Moved tests from lib to
tests
#1001 (jorgecarleitao) - Allowed feature-specific test runs #985 (jorgecarleitao)