v0.0.19

What's Changed

• MongoDB: Fix and verify Zyp transformations by @amotl in #240
• DMS/DynamoDB/MongoDB: Use SQL with parameters instead of inlining values by @amotl in #243

Full Changelog: v0.0.18...v0.0.19

v0.0.18

What's Changed

• Dependencies: Unpin commons-codec, to always use the latest version
• Dependencies: Unpin lorrystream, to always use the latest version
• MongoDB: Improve type mapper by discriminating between
  INTEGER and BIGINT
• MongoDB: Improve type mapper by supporting BSON DatetimeMS,
  Decimal128, and Int64 types

Full Changelog: v0.0.17...v0.0.18

v0.0.17

What's Changed

• Processor: Updated Kinesis Lambda processor to understand AWS DMS
• MongoDB: Fix missing output on STDOUT for migr8 export
• MongoDB: Improve timestamp parsing by using python-dateutil
• MongoDB: Converge _id input field to id column instead of dropping it
• MongoDB: Make user interface use stderr, so stdout is for data only
• MongoDB: Make migr8 extract write to stdout by default
• MongoDB: Make migr8 translate read from stdin by default
• MongoDB: Improve user interface messages
• MongoDB: Strip single leading underscore character from all top-level fields
• MongoDB: Map OID types to CrateDB TEXT columns
• MongoDB: Make migr8 extract and migr8 export accept the --limit option
• MongoDB: Fix indentation in prettified SQL output of migr8 translate
• MongoDB: Add capability to give type hints and add transformations
• Dependencies: Adjust code for lorrystream version 0.0.3
• Dependencies: Update to lorrystream 0.0.4 and commons-codec 0.0.7
• DynamoDB: Add table loader for full-load operations

Details

• Update polars requirement from <1.3 to <1.4 by @dependabot in #209
• CI: Update to Docker Compose V2 by @amotl in #214
• Processor: Update Kinesis Lambda processor to understand AWS DMS by @amotl in #217
• Update fastapi requirement from <0.112 to <0.113 by @dependabot in #211
• Update polars requirement from <1.4 to <1.5 by @dependabot in #212
• Chore: Unpin kaggle dependency by @amotl in #220
• Bump cratedb-sqlparse from 0.0.4 to 0.0.6 by @dependabot in #208
• MongoDB: Various fixes and improvements by @amotl in #216
• Chore: Fix reference to LorryStream WIP by @amotl in #223
• Dependencies: Update to lorrystream 0.0.4 and commons-codec 0.0.6. Adjust code. Add software tests. by @amotl in #224
• Dependencies: Update to commons-codec 0.0.7 by @amotl in #225
• Update ruff requirement from <0.6 to <0.7 by @dependabot in #228
• Update myst-parser[linkify] requirement from <4,>=0.18 to >=0.18,<5 by @dependabot in #227
• Update polars requirement from <1.5 to <1.6 by @dependabot in #230
• DynamoDB: Add table loader for full-load operations by @amotl in #226

Full Changelog: v0.0.16...v0.0.17

v0.0.16

What's Changed

• ctk load table: Added support for MongoDB Change Streams
• Fix dependency with the kaggle package, downgrade to kaggle==1.6.14
• DynamoDB CDC: Add demo to support reading DynamoDB change data capture

Details

• Chore: Satisfy linter, add inline comments, improve documentation by @amotl in #197
• Project: Move from GitHub organization crate-workbench to crate by @amotl in #200
• Update polars requirement from <1.2 to <1.3 by @dependabot in #198
• Update pyarrow requirement from <16.1 to <17.1 by @dependabot in #199
• Setup: Fix package installation woes with setuptools/backports.tarfile, and PyInstaller by @amotl in #201
• Core: Improve quoting for TableAddress.fullname by @amotl in #202
• Update mypy requirement from <1.11 to <1.12 by @dependabot in #203
• ctk load table: Add support for MongoDB Change Streams by @amotl in #196
• Dependencies: Downgrade to kaggle==1.6.14 by @amotl in #206
• DynamoDB CDC: Add demo to support reading DynamoDB change data capture by @amotl in #205

Full Changelog: v0.0.15...v0.0.16

v0.0.15

What's Changed

• IO: Added the if-exists query parameter by updating to influxio 0.4.0.
• Rockset: Added CrateDB Rockset Adapter, a HTTP API emulation layer
• MongoDB: Added adapter amalgamating PyMongo to use CrateDB as backend
• SQLAlchemy: Clean up and refactor SQLAlchemy polyfills
  to cratedb_toolkit.util.sqlalchemy
• CFR: Build as a self-contained program using PyInstaller
• CFR: Publish self-contained application bundle to GitHub Workflow Artifacts

Details

• IO: Add the if-exists query parameter by updating to influxio 0.4.0 by @amotl in #176
• Update ruff requirement from <0.5 to <0.6 by @dependabot in #178
• Update poethepoet requirement from <0.27 to <0.28 by @dependabot in #180
• Update uvicorn requirement from <0.25 to <0.31 by @dependabot in #181
• Bump docker/build-push-action from 5 to 6 by @dependabot in #182
• Adapter: Add very basic Rockset HTTP API emulation layer by @amotl in #183
• Chore: A few maintenance adjustments by @amotl in #184
• Testing: Add pytest fixtures to discriminate between SQLAlchemy 1 and 2 by @amotl in #185
• MongoDB/PyMongo: Amalgamate PyMongo driver to use CrateDB as backend by @amotl in #83
• Chore: Clean up and refactor SQLAlchemy polyfills by @amotl in #186
• CI: Maintenance, this and that by @amotl in #187
• Bump actions/setup-python from 4 to 5 by @dependabot in #188
• Update polars requirement from <0.21 to <1.1 by @dependabot in #189
• Add support to publish cfr as a binary using PyInstaller by @amotl in #175
• Update polars requirement from <1.1 to <1.2 by @dependabot in #193
• Chore: This and that by @amotl in #194

Full Changelog: v0.0.14...v0.0.15

v0.0.14

What's Changed

• Added ctk cfr and ctk wtf diagnostics programs
• Removed support for Python 3.7
• SQLAlchemy dialect: Use sqlalchemy-cratedb>=0.37.0
  This includes the fix to the get_table_names() reflection method.

Details

• Dependencies: Use sqlalchemy-cratedb>=0.36.1,<1 by @amotl in #164
• Add CFR and WTF diagnostics programs by @amotl in #88
• cfr: Add support to directly export to an archive file by @seut in #153
• SQLAlchemy Dialect: Dependencies: Use sqlalchemy-cratedb>=0.37 by @amotl in #94
• Use sqlalchemy's 'quote' function to quote table names and fix table quoting in cfr exporter by @seut in #172
• CI: Add GHA workflow recipe for staging packages to PyPI, release-pypi.yml by @amotl in #173
• Project: Add surrogate setup.py to satisfy GitHub by @amotl in #174

New Contributors

• @seut made their first contribution in #153

Full Changelog: v0.0.13...v0.0.14

v0.0.13

What's Changed

• Dependencies: Migrate from crate[sqlalchemy] to sqlalchemy-cratedb

Details

• Update sqlparse requirement from <0.5 to <0.6 by @dependabot in #159
• Update pyproject-fmt requirement from <1.8 to <2.2 by @dependabot in #157
• Update myst-parser[linkify] requirement from <3,>=0.18 to >=0.18,<4 by @dependabot in #158
• Update validate-pyproject requirement from <0.17 to <0.19 by @dependabot in #155
• CI: Run nightly testing jobs each second night only by @amotl in #161
• Dependencies: Migrate from crate[sqlalchemy] to sqlalchemy-cratedb by @amotl in #163

Full Changelog: v0.0.12...v0.0.13

v0.0.12

What's Changed

• Fix InfluxDB Cloud <-> CrateDB Cloud connectivity by using
  ssl=true query argument also for influxdb2:// source URLs.

Full Changelog: v0.0.11...v0.0.12

v0.0.11

What's Changed

• Fix InfluxDB Cloud <-> CrateDB Cloud connectivity by propagating
  ssl=true query argument. Update dependencies to influxio>=0.2.1,<1.

Details

• Update poethepoet requirement from <0.26 to <0.27 by @dependabot in #137
• Update responses requirement from <0.25 to <0.26 by @dependabot in #138
• Bump croud from 1.10.1 to 1.11.1 by @dependabot in #141
• Chore: Update to mypy 1.10 and ruff 0.4 by @amotl in #143
• Documentation: Serve docs via https://cratedb-toolkit.readthedocs.io/ by @amotl in #145
• Documentation: Improve structure and layout by @amotl in #146
• Fix InfluxDB Cloud <-> CrateDB Cloud connectivity by @amotl in #152

Full Changelog: v0.0.10...v0.0.11

v0.0.10

What's Changed

• Dependencies: Unpin upper version bound of dask. Otherwise, compatibility
  issues can not be resolved quickly, like with Python 3.11.9.
  See: dask/dask#11038

Details

• Update pytest requirement from <8 to <9 by @dependabot in #129
• Bump ruff from 0.1.15 to 0.3.4 by @dependabot in #130
• Update boltons requirement from <24 to <25 by @dependabot in #131
• Update testcontainers requirement from <4 to <5 by @dependabot in #132
• Update pytest-cov requirement from <5 to <6 by @dependabot in #133
• Dependencies: Unpin upper version bound of dask by @amotl in #135

Full Changelog: v0.0.9...v0.0.10