Skip to content

Latest commit

 

History

History
443 lines (379 loc) · 37.4 KB

CHANGELOG.md

File metadata and controls

443 lines (379 loc) · 37.4 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Unreleased / Draft

1.2.0 - 2021-05-31

Added

  • New extensions:
  • GET /: New Relation types: #404
    • create-form to link to the registration page
    • recovery-form to link to the credentials recovery page.
  • GET /file_formats: Add pointcloud to the gis_data_types. #475
  • GET /me: New Relation types alternate and related for user-specific external pages. #404
  • GET /credentials/oidc: Allow authorization_code and urn:ietf:params:oauth:grant-type:device_code (both without PKCE) as grants for default_clients. #410
  • GET /jobs and GET /jobs/{job_id}: Added a links property that can for example link to results and logs. #453
  • GET /jobs/{job_id}/results:
    • Recommendation to add a link with relation type canonical which points to a signed URL with the same content as the response. #397
    • Added metadata field openeo:status to indicate the job status (and whether the result is complete or not).
    • Added parameter partial to allow retrieving incomplete results, which must also add the new property openeo:status to the metadata. #430
  • GET /jobs/{job_id}/logs, GET /services/{service_id}/logs: Added level parameter to requests to set the minimum log level returned by the response. #485
  • Added property log_level to secondary web service, batch job and synchronous processing endpoints to indicate the minimum severity level that should be stored for logs. #329
  • GET /jobs/{job_id}/logs, GET /services/{service_id}/logs and POST /result: Added level property in responses to reflect the minimum log level that may appear in the response. #329
  • Recommendation to add media types and titles to links for a better user experience.
  • Allow the relation type canonical to be used generally for (shared) resources (e.g. UDPs or batch jobs) without requiring Bearer authentication. #405
  • Recommendation for UDF runtime names. #409
  • Processes: Added dimensions schema for subtype datacube
  • Collections: Added geometry dimension type to cube:dimensions
  • New endpoint for metadata filters (queryables): /collections/{collection_id}/queryables. Also adds a new rel type to the collection links. #396

Changed

  • Updated STAC specification examples and references to v1.0.0, please see the STAC changelog for all changes between 0.9 and 1.0.
  • cube:dimensions: reference_system is allowed to be PROJJSON, too.
  • Relaxed requirement that unsupported endpoints must return HTTP status code 501. Instead also HTTP status code 404 can be used (and is regularly used in practice). #415
  • Minimum value for costs and budget is 0.
  • GET /jobs/{job_id}/estimate: If a batch job can't be estimated reliably, a EstimateComplexity error should be returned. #443
  • The /conformance endpoint is now generally used for OGC APIs, STAC API and openEO. conformsTo is also exposed in GET / for STAC APIs. The openEO API and all extensions got individual conformance classes. #186

Fixed

  • Explicitly mention the use of HTTP content negotiation
  • Clarify that the default charset is UTF-8 #462
  • Fixed inconsistencies in errors.json: removed ProcessGraphIdDoesntMatch, clarified ProcessGraphMissing, added ProcessInvalid and ProcessGraphInvalid. #394, #395, #401
  • Fixed the default value for the version number in the API url (v1.0 -> v1) and improved the description for API versioning. #393
  • Fixed the Collection example to use gsd instead of eo:gsd. #399
  • Clarify use of user_id. #404
  • Clarify that the relation type version-history should include /.well-known/openeo in the URL.
  • Clarify that clients should (re-)request capabilities and discovery endpoints with token if available and supported. #416
  • Clarify the fields plan (for processing requests) and billing_plan (in GET / and GET /me). #425 #426
  • Clarified ambiguous batch job status changes.
  • Reflect that the debug process has been renamed to inspect.
  • Clarified uniqueness constraints for identifiers. #449 #454
  • Clarified schematically the applicability of JSON Schema extensions (parameters, returns, dimensions) and their relation to the subtypes
  • GET /: Removed the superfluous default value for currency. #423
  • GET /credentials/oidc: Clarify that clients may add additional scopes
  • GET /me: Clarify the behavior of the field budget.
  • GET /jobs/{job_id}/logs, GET /services/{service_id}/logs and POST /result: Clarified the formatting of the message property. #455
  • GET /jobs/{job_id}/estimate: Don't require that the costs are the upper limit. Services may specify the costs more freely depending on their terms of service.
  • GET /services and GET /services/{service_id}: Clarify that enabled is required by removing the default value. #473
  • Several appearances of nullable were clarified according to the lint report by Spectral
  • Clarify how the well-known document works #460
  • Clarify handling of JSON Schema versions

1.1.0 - 2021-05-17

Added

  • GET /processes and GET / PUT for /process_graphs/{process_graph_id}: Allow specifying the return values processes receive from child processes. #350
  • Recommendation that POST /result returns a tar file if the result consists of multiple files. #349
  • GET /credentials/oidc can provide a set of default client ids for OpenID Connect. #366
  • experimental and deprecated flags added for file formats, service types, udf runtimes, udf runtime versions, udf runtime libraries and all related parameters and schemas. #354
  • GET /jobs/{job_id} and GET /services/{service_id}: usage property added for usage metrics. #370
  • GET /jobs/{job_id}/logs and GET /services/{service_id}/logs:
    • time property added. #330
    • usage property added to log entries. #370
  • Added error ResultLinkExpired. #379
  • GET /me: A default plan per user can be specified. #375

Changed

  • API doesn't discourage usage of multipleOf in JSON Schemas any longer.
  • GET /jobs/{job_id}/results supports to return a STAC Collection. #343
  • Updated STAC schemas to better support versions 1.x.x.
  • The first extent in a Collection is always the overall extent, followed by more specific extents. #369

Fixed

  • Clarified how process exceptions should be used. #352
  • Clarified that job results schould be stored as valid STAC catalogs. #363
  • Clarified that job results require the property datetime and allow for additional properties. #362
  • Clarified that billing plans, service names and file formats must be accepted case-insensitive. #371
  • Clarified that the first provider listed at GET /credentials/oidc is the default provider for OpenID Connect.
  • Clarified that GET /jobs/{job_id}/results should always return valid signed URLs and the endpoint can be used to renew the signed URLs. #379
  • Fixed casing of potential endpoints GET /collections/{collection_id}/items and GET /collections/{collection_id}/items/{feature_id}.
  • Clarified allowed characters in the path for uploaded user files.

1.0.1 - 2020-12-07

Changed

  • GET /collections and GET /collections/{collection_id}: Units for STAC dimensions in cube:dimensions should be compliant to UDUNITS-2 units (singular) whenever available.
  • GET /file_formats: It is recommended to at least specify one of the data types in gis_data_types. #325

Fixed

  • Cross-Origin Resource Sharing (CORS):
    • SECURITY: It is recommended to set Access-Control-Allow-Origin to * instead of reflecting the origin. #41
    • SECURITY: It is recommended to NOT send the Access-Control-Allow-Credentials header any more. #41
    • Added missing Link header to Access-Control-Expose-Headers. #331
  • GET /: Missing option OPTIONS added to allowed methods for the endpoints. #324
  • For PATCH requests: Clarified that no default values apply (for budget, enabled and plan). Data is only changed on the back-end if new data is explicitly specified by the client.
  • For POST requests with a plan property: Clarify that the default value is null.
  • GET /jobs/{job_id}/results: Clarified the use of the type Feature in the GeoJSON result response. #327
  • Add missing {namespace} placeholder to ProcessUnsupported error message. #328
  • Fixed JSON Schema links to point to draft-07 instead of draft/2019-09.
  • GET /jobs/{job_id}/estimate: Enforce in the response schema that "at least one of costs, duration or size MUST be provided."

1.0.0 - 2020-07-17

Added

  • GET /me: Added optional name property to better separate an internal user id from a displayable user name. Adopted description of user_id accordingly.
  • GET /udf_runtimes:
    • Added optional title property for UDF runtimes. #266
    • Added required type property for UDF runtimes to support better code generation.
  • GET /service_types: Added optional title and description properties for service types. #266
  • GET /file_formats: Added optional description property for file formats. #266
  • GET /collections/{collection_id} and GET /processes: Mention of link rel type example to refer to examples. #285
  • GET /collections/{collection_id}: Added optional assets property for collection-level assets. This may link to visualizations for example. #211
  • GET /collections, GET /jobs, GET /process_graphs, GET /services: Allow all non-scalar properties to be part of the response although strongly discouraged.

Changed

  • GET /credentials/oidc: field scopes is not required anymore, but when specified, it should contain the openid scope. #288
  • GET /.well-known/openeo and GET /: production fields default to false instead of true.
  • GET /jobs/{job_id}/logs and GET /services/{service_id}/logs: path property is not required any longer. #320
  • GET /file_formats: parameters is now required for each file format. #318
  • GET /service_types: configuration and process_parameters are now required for each service. #318
  • GET /service_types and GET /file_formats:
    • Allow full JSON Schema for parameters, instead of a very limited subset.
    • Instead of the proprietary property example use examples from JSON Schema instead.
  • GET /collections and GET /collections/{collection_id}:
    • Additional dimensions in cube:dimensions can only be of type other.
    • The extents interval and bbox can have multiple entries.
  • Allow all STAC versions that are compatible to STAC 0.9.0.
  • Process graph nodes have an additional field namespace to distinguish predefined and user-defined processes. The default behavior has not changed. #305
  • Added format: commonmark to all properties supporting CommonMark formatting.
  • errors.json: The predefined error messages have been reworked. #272, #273
    • Added FolderOperationUnsupported, UnsupportedApiVersion, PermissionsInsufficient, ProcessGraphIdDoesntMatch and PredefinedProcessExists.
    • Added variable reason to error FilePathInvalid and type to FileTypeInvalid andServiceUnsupported.
    • Replaced the following error messages. The variables in the messages may have changed, too.
      • ProcessArgumentUnsupported -> ProcessParameterUnsupported
      • ProcessArgumentInvalid -> ProcessParameterInvalid
      • ProcessParameterMissing and ProcessArgumentRequired -> ProcessParameterRequired
      • ServiceArgumentUnsupported -> ServiceConfigUnsupported
      • ServiceArgumentInvalid -> ServiceConfigInvalid
      • ServiceArgumentRequired -> ServiceConfigRequired
    • Removed all error messages with tag Processes (CRSInvalid, CoordinateOutOfBounds) or related to storing file formats (FormatUnsupported, FormatArgumentUnsupported, FormatArgumentInvalid, FormatUnsuitable) as they are usually defined directly in the process specification as exceptions.

Removed

  • GET /processes: Examples containing process graphs. Use links with rel type example and type set to application/json instead. #285
  • subtype-schemas.json. It's now published as part of openeo-processes.

Fixed

  • /.well-known/openeo:
    • Clarified that version numbers must be unique. #287
    • Clarified that non-production ready versions should be connected to if no production-ready version is supported. #289
  • GET /jobs/{job_id}/results: Clarified that unlocated results set geometry to null and omit the bbox property.
  • GET /jobs/{job_id}/logs: Clarified that back-ends can log at any stage of the job. #315
  • POST /jobs and POST /services: Clarified definition of Location header in HTTP 201 responses. #269
  • GET /service/{service_id}: Property configuration is required instead of a non-existing property named parameters.
  • POST /validation: Clarify that unresolvable process parameters must not throw. #314
  • Formally forbid 5 elements in bounding boxes.
  • Re-use corresponding schema for header OpenEO-Identifier (adds pattern).
  • Parameters passed to child process graphs are not defined recursively any longer. #268
  • Parameters for child process graphs are not specified for return values and service type parameters any longer. #268
  • Clarified the expected behavior for process parameters, if a default value is given and the parameter is implicitly set to be required. #303
  • Several clarifications and improvements for the documentation.

[1.0.0-rc.2] - 2020-02-20

Added

  • PUT /process_graphs/{process_graph_id} to store and replace custom process-graphs. #260
  • GET .../logs: Reintroduced the missing offset parameter.

Changed

  • For batch jobs (/jobs), services (/services) and sync. processing (/result) the property process_graph got replaced by process. It contains a process graph and optionally all process metadata. #260
  • GET /process_graphs: Field id is required for each process.
  • Several properties in user-defined processes can now be null (see also #264):
    • GET /process_graphs and GET /process_graphs/{process_graph_id}: Process properties summary, description, parameters and returns.
    • POST /validation: Process property id.
    • Child processes in process graphs (fka callbacks): id, summary, description, parameters and returns.

Removed

  • POST /process_graphs and PATCH /process_graphs/{process_graph_id}. Use PUT /process_graphs/{process_graph_id} instead. #260

Fixed

  • Added $id to JSON Schema file for subtypes.
  • Fixed invalid EPSG code example.
  • Fixed collection example (sat:cloud_cover changed to eo:cloud_cover).
  • Fixed invalid JSON Schema for process graph validation (used from_argument instead of from_parameter).
  • Clarified how version numbers in well-known discovery are compared. #259
  • Clarified that back-ends not supporting pagination will return all resources.
  • Clarified how from_parameter is resolved in case no value is given.
  • Clarified GET .../logs endpoint behaviour.
  • Clarify difference between STAC specification and STAC API.
  • Clarify that a copy of the STAC Item is recommended to be part of the assets in a batch job download.
  • Removed outdated error codes from errors.json.

[1.0.0-rc.1] - 2020-01-31

Note: The user and developer documentation has been moved to openeo.org.

Added

  • GET /:
    • Field production added to response. #184
    • Required fields stac_version and id added to response for STAC compatibility. #247
    • Links with relation types terms-of-service and privacy-policy explicitly documented. Clients must handle them properly if present. #212
  • GET /collections and GET /collections/{collectionId}:
    • New field deprecated can be used to indicate outdated collections. Links with relation type latest-version can point to the latest version. #226
    • Added a Data Cube Dimension of type bands to the cube:dimensions property. #208
  • GET /conformance has been added for OCG API compliance. Back-ends may implement it for compatibility with OGC API clients.
  • POST /result: May add a link to a log file in the header. #214
  • GET /jobs/{job_id}/logs and GET /services/{service_id}/logs: Endpoints that publish logging information. #214
  • GET /files, GET /jobs, GET /process_graphs, GET /services, GET /collections, GET /processes: Added limit parameter for pagination and clarified how to use links for pagination. #103
  • JSON Schema for the defined schema subtypes.

Changed

  • The concept of callbacks has simply been renamed to process graph. Schema format/subtype callback has been renamed to process-graph. #216
  • Unsupported endpoints are not forced to return a FeatureUnsupported (501) error and can return a simple NotFound (404) instead.
  • If currency returned by GET / is null, costs and budget are unsupported. costs and budget fields in various endpoints can be set to null (default).
  • Official support for CommonMark 0.29 instead of CommonMark 0.28. #203
  • The parameter user_id has been removed from the endpoints to manage user files (/files/{user_id}). #218
  • Schema subtype band-name allows common band names, too. Processes#77
  • Link property rel is required.
  • OpenAPI string format url has been replaced with uri.
  • Process graphs:
    • from_argument has been renamed to from_parameter.
    • callback has been renamed to process_graph.
    • from_parameter can access parameters defined in parent scopes.
    • from_parameter can be used in the top-level process graph.
    • Process graph variables (objects with variable_id etc.) have been removed.
  • GET /jobs, GET /jobs/{job_id}, GET /services and GET /services/{service_id}: Renamed field submitted to created for consistency with STAC job results. Also renamed the corresponding value in the field status for batch jobs.
  • GET /: Property links is required.
  • GET /service_types: variables has been renamed to process_parameters and has a different schema now. #161
  • GET /service_types, POST /services, GET /services/{service_id}, PATCH /services/{service_id}: parameter has been renamed to configuration to not overlap with process_parameters.
  • GET /processes:
    • Default values are now specified on the parameter-level, not in the JSON schemas.
    • Multiple data types in parameters or return values are supported as arrays. Using anyOf is discouraged.
    • Parameters are defined as array. parameter_order is therefore removed and the name is part of the parameter object. #239
    • Process graph (callback) parameters have a new, more advanced schema, allowing to define more aspects of the process graph parameters. #239
    • Return values don't require a description any longer.
    • required was replaced with optional with inverted behavior.
  • POST /process_graphs,GET /process_graphs/{process_graph_id}, PATCH /process_graphs/{process_graph_id}, POST /validation: Request and response bodies have been completely reworked to follow the same schema as GET /processes. Each process graph is now basically a process a user can use in other process graphs.
  • GET /collections and GET /collections/{collectionId}: Updated STAC to version 0.9.0. See the STAC Changelog for more details. #247, #204.
  • GET /credentials/oidc: Changed response to support multiple OpenID Connect identity providers (#201) and clarified workflow overall.
  • Bearer token are built from the authentication method, an optional provider id and the token itself. #219
  • GET /udf_runtimes: description fields don't allow null values any longer.
  • GET /output_formats renamed to GET /file_formats to allow listing input file formats. #215
    • The structure of the response has changed. The former response body for the output formats is now available in the property output.
    • The input file formats are now available in the property input with the same schema as for output formats.
    • Additionally, each format can have a title.
  • GET /jobs/{job_id}/results:
    • Response body for status code 200 has changed to be a valid STAC Item, allows content type application/geo+json.
    • Response body for status code 424 has been extended.

Deprecated

  • The processes should not use the JSON Schema keyword format any longer. Instead use the custom keyword subtype. #233
  • PROJ definitions are deprecated in favor of EPSG codes and WKT2. #58

Removed

  • Process graph variables. Use Parameter References instead.
  • GET /processes: media_type removed from parameters and return values. Use contentMediaType in the JSON Schema instead.
  • GET /job/{job_id}: Removed property error. Request information from GET /job/{job_id}/logs instead.
  • GET /job/{job_id}/results:
    • Metalink XML encoding has been removed. #205
    • Expires header has been removed, use expires property in the response body instead.
  • GET /credentials/basic doesn't return a user_id. Instead request it from GET /me.
  • GET /collections/{collectionId}: Removed optional STAC extensions from the API specification. Inform yourself about useful STAC extensions instead. #176
  • GET /service_types doesn't support attributes any longer.

Fixed

  • Service parameters and attributes in GET /service_types and output format parameters in GET /file_formats (previously GET /output_formats) now have a type, which was previously only mentioned in examples.
  • GET /processes: Parameters arguments and process_graph can't be used together in process examples.
  • GET ./well-known/openeo: Clarified how clients and back-ends should implement well-known discovery. #202

0.4.2 - 2019-06-11

Added

  • Basic JSON Schema for process graph validation.

Changed

  • Updated the process catalog, see the separate changelog.

Removed

  • Disallowed CommonMark in descriptions of process graph variables and process graph nodes.

Fixed

  • Improved documentation with several clarifications, better examples and more.
  • SAR Bands had a required but undefined property. #187
  • Clarified how file paths in the URL must be encoded for file handling.
  • OpenAPI nullable issues:

0.4.1 - 2019-05-29

Changed

  • Updated the process catalog, see the separate changelog.

Removed

  • The property sar:absolute_orbit in GET /collections/{collection_id} has been removed.
  • Sending a Bearer token to GET /credentials/oidc is not allowed any longer.

Fixed

  • Improved and clarified the documentation and descriptions.
  • GET /collections/{collection_id}:
    • properties in GET /collections/{collection_id} doesn't require any of the integrated STAC extensions any longer.
    • The property sci:publications in GET /collections/{collection_id} was ported over incorrectly from STAC. The data type has been changed from object to array.
  • GET /jobs/{job_id}/results was expected to return HTTP status code 424 with an error message, but it was specified in /jobs/{job_id}/estimate instead. The definition was moved. #177
  • path in GET and PUT /files/{user_id} is required again.
  • Fixed several issues in the client development guidelines.

0.4.0 - 2019-03-07

Added

  • GET /jobs/{job_id}/estimate can return the estimated required storage capacity. #122
  • GET /jobs/{job_id} has two new properties:
    • progress indicates the batch job progress when running. #82
    • error states the error message when a job stopped due to an error. GET /jobs/{job_id}/result mirrors this error message in a response with HTTP status code 424. #165
  • GET /.well-known/openeo allows clients to choose between versions. #148
  • GET / (Capabilities):
    • Requires to return a title (title), a description (description) and the back-end version (backend_version). #154
    • Billing plans have an additional required property paid. #157
    • Should provide a link to the Well-Known URI (/.well-known/openeo) in the new links property.
  • GET /processes (Process discovery):
    • Processes can be categorizes with the category property.
    • Parameters can be ordered with the parameter_order property instead of having a random order.
    • Support for references to other processes in descriptions.
    • Processes and parameters can be declared to be experimental.
  • GET /output_formats and GET /service_types can now provide links per entry.
  • GET /udf_runtimes provide a list of UDF runtime environments. #87
  • GET /service_types allows to specify variables that can be used in process graphs. #172

Changed

  • Completely new version of the processes.
  • Changed process graph to a flexible graph-like structure, which also allows callbacks. #160
  • Updated GET /collections and GET /collections/{collection_id} to follow STAC v0.6.2. #158, #173
  • The process_graph_id of stored process graphs, the service_id of services and the job_id of jobs has changed to id in responses. #130
  • The status property for jobs is now required.
  • POST /preview renamed to POST /result. #162
  • GET / (Capabilities):
    • version in the response was renamed to api_version.
    • Endpoint paths must follow the openAPI specification. #128
    • Billing plan descriptions allow CommonMark. #164
  • /files/{user_id}/{path} File management:
    • Clarified handling of folders. #146
    • GET method: The name property was renamed to path. #133
    • PUT method: Returns file meta data with a different response code. #163
  • GET /processes (Process discovery):
    • The name property of processes has changed to id. #130
    • mime_type replaced with media_type in the input parameters and return values.
    • The schema for exceptions follows the general schema for openEO errors. #139
    • Changed the structure of examples.
  • POST /validation (Process graph validation):
    • Returns HTTP status code 200 for valid and invalid process graphs and responds with a list of errors. #144
    • Allowed to call the endpoint without authentication. #151
  • Behavior for DELETE /jobs/{job_id}/results and POST /jobs/{job_id}/results specified depending on the job status. Clarified status changes in general. #142
  • Improved client development guidelines. #124, #138

Removed

  • Numeric openEO error codes. Replaced in responses with textual error codes. #139
  • Query parameters to replace process graph variables in GET /process_graphs/{process_graph_id}. #147
  • min_parameters and dependencies for parameters in process descriptions returned by GET /processes.
  • Replaced output format properties in favor of a save_result process, which has resulted in in the removal of:
    • The default output format in GET /output_formats. #153
    • The output format properties in POST /result (fka POST /preview), POST /jobs, PATCH /jobs and GET /jobs/{job_id} requests. #153
    • gis_data_type (not to be confused with gis_data_types) in the parameters of output formats in GET /output_formats

Fixed

  • Added missing Access-Control-Expose-Headers header to required CORS headers.
  • Some endpoints didn't include authentication information.
  • GET /jobs/{job_id}/estimate: Property downloads_included had a wrong default value.

[0.3.1] - 2018-11-06

Added

  • createProcessGraph method to client development guidelines.
  • JSON file with all specified errors.
  • Textual error codes for each specified error.
  • Allow setting a plan for POST /preview
  • Default billing plan in GET /. #141
  • Job ID in JSON response for GET /jobs/{job_id}/results.

Changed

  • Several optional fields such as output, title and description are now nullable instead of requiring to omit them.
  • The output format is not required in POST /preview any more and thus allows falling back to the default.
  • The output_format parameter in createJob and execute in client development guidelines.
  • The extent parameters in filter_bbox and filter_daterange are formally required now.

Deprecated

  • Numeric openEO error codes are soon to be replaced with textual error codes.
  • eo:resolution in collection bands is a duplicate of eo:gsd. Use eo:gsd instead.

Fixed

  • Fixed a wrong definition of the header OpenEO-Costs in POST /preview.
  • Fixed typo in method authenticateOIDC in client development guidelines.
  • Fixed the definition of spatial extents by swapping north and south.
  • Replaced the outdated occurrences of srs with crs in spatial extents.
  • Added missing required descriptions to process definitions.
  • Added missing error messages.
  • Fixed unclear specification for arrays used as process graph arguments.
  • Fixed inconsist schema of openEO error responses: Field is now consistently named message instead of description.

0.3.0 - 2018-09-21

First version after proof of concept tackling many major issues. No changelog available.

0.0.2 - 2018-03-22

Version for proof of concept. No changelog available.

0.0.1 - 2018-02-07

Initial version.