v0.0.25
What's Changed
- Table Loader: Improved conditional handling of "transformation" parameter
- Table Loader: Improved status reporting and error logging in
BulkProcessor
- MongoDB: Improve error reporting
- MongoDB Full: Polars'
read_ndjson
doesn't load MongoDB JSON data well, usefsspec
andorjson
instead - MongoDB Full: Improved initialization of transformation subsystem
- MongoDB Adapter: Improved performance of when computing collection cardinality by using
collection.estimated_document_count()
- MongoDB Full: Optionally use
limit
parameter as number of total records - MongoDB Adapter: Evaluate
_id
filter field by upcasting tobson.ObjectId
, to convey a filter that makesctk load table
process a single document, identified by its OID - MongoDB Dependencies: Update to commons-codec 0.0.17
Full Changelog: v0.0.24...v0.0.25