v0.7.2

• Pin the lxml release to v4.4.3 (later versions break our dags 😢 )

v0.7.1

• Fix fails when OAI returns empty list
• Fix fails when OAI record has no metadata
• Allow override of Sickle classes
• Move CI to circle ci.
• Upgrades to apache airflow 1.10.14
• Refactor some aws s3 calls to allow for overriding.

v0.6.3...v0.7.1

Fix does not retry harvest on 500 error.

Merge pull request #55 from tulibraries/add-http-retries

Fix harvest not retrying on 500 error.

Retry OAI Harvest more generously

Will now retry failed OAI harvest requests if it receives 500 or 503 response, instead of just the default 503.

Raise Exception when all records in all files deleted.

• Only raise an exception if all records in all files get deleted, not if some files still have records.

Add Exception

When everything gets filtered throw and exception.

Improved Logging

Adds better logging for

• OAI Harvests
• CSV Harvests
• Schematron Validation reports
• Schematron Filtering
• Fix handling namespacing to prevent dynamic namespaces in every record

Update README.md and dependencies

Updates

• Adds instructions to README.md

Fixes

• Pins lxml and werkzeug(recent versions are causing things to break)

Log fetching csv lookup file from s3.

Merge pull request #41 from tulibraries/log-fetching-from-s3

Log fetching csv file from aws s3.

Cache pulling CSV from s3

• caches pulling csv from s3
• updates maven link to new https version.