v3.1.0 alpha
Pre-releaseWhat's Changed
Liquibase introduction
From the 3.1.0 release on, the LDES server contains a migration path between each release.
No extra configuration is needed, all needed tables and migrations will be done on the fly.
Fragmentation rework (batching)
The fragmentation got a big rework to focus towards a more performant LDES Server.
The 2 processes (bucketisation and pagination) are now split up:
- Bucketisation: Based on the configured fragmentation strategy and a given LDES member, the member can be assinged to a number of buckets. This will be reflected in the relations in the LDES fragments.
- Pagination: For each of the assigned buckets, the members will be paginated. This happens based on the configured memberCount per page.
These processes will now work with a time interval to process more members at the same time.
Geospatial fragmentation update
Previously, there was an issue in the geospatial fragmentation where only the tiles that contains the points of a shape were taken.
In the below example, A3 and D3 were taken as tiles of a geospatial fragmentation, but the others were ignored.
From now on, also tiles B3, C2 and C3 are taken.
Closing of an LDES
If, as a dataowner, you know no more data will be ingested in an Event Stream, there is now the ability to close the stream (turns the latest page immutable).
This gives the advantage that the LDES Client can stop following the LDES without needlessly polling for updates that will never come.
To close an LDES, please visit the swagger endpoint.
Change notes
- f:eat: split pagination and fragmentation by @pj-cegeka in #1294
- fix: add liquibase profile by @pj-cegeka in #1297
- feat: VSDSPUB-1283: Close LDES by @ferre-vaes in #1296
- fix: adapt ldes closure endpoint by @ferre-vaes in #1304
- feat: calculate intersecting tiles of geo feature by @ferre-vaes in #1309
- feat: fragmentation batching by @Yalz in #1311
- feat: new data model definition for event streams by @jobulcke in #1307
- fix: invalid documentation by @jobulcke in #1312
- fix: code smells by @jobulcke in #1317
- chore: finalise 3.1.0 by @Yalz in #1318
Full Changelog: v3.0.0-alpha...v3.1.0-alpha