Architecture and software building-blocks for data exploitation and platform interoperability.
Earth Observation (EO) data has quickly evolved into an indispensable resource, directly facilitating solutions for society's most pressing challenges. This intensifying influx of data, oftentimes distributed across multiple independent platforms, presents a significant challenge for end-users in efficiently accessing and collaborating on critical geospatial tasks. Nevertheless, these platforms are more commonly collocated with cloud computing resources and applications such that users are now able to perform geospatial analysis tasks remotely. Working in the cloud bypasses traditional download, storage and performance limitations, however the distributed nature of these platform networks introduces complexities in the free and collective access to this remote geospatial data.
Our vision with EOEPCA then is for greater interoperability between such platforms, towards an open network of resources, whilst enabling current and future users to easily collaborate on geospatial analysis tasks at source. To this end we are helping to establish a consensus of best practice for EO Exploitation Platforms, based on open standards. Supporting that, we are developing a reference implementation of building blocks, as free open source software.
The goal of the EOEPCA's “Common Architecture” is therefore to define and agree the technical interfaces for the future exploitation of Earth Observation data in a distributed environment. The Common Architecture will provide the interfaces to facilitate the federation of different EO resources into a “Network of EO Resources”. The “Common Architecture” will be defined using open interfaces that link the different Resource Servers (building blocks) so that a user can efficiently access and consume the disparate services of the “Network of EO Resources”.
System...
- EOEPCA Release v1.4 - https://github.com/EOEPCA/eoepca/releases/tag/v1.4
- Deployment Guide (latest) - https://eoepca.readthedocs.io/projects/deploy/en/latest/
- Helm Charts - https://eoepca.github.io/helm-charts [sources]
Building Blocks...
- ADES - ZOO-Project DRU (Application Deployment & Execution Service) - [repository] [docs]:
- Helm chart
- eoepca-proc-service-template - Cookie-cutter template for Application Package execution in Kubernetes
- zoo-calrissian-runner - Python library used by the
eoepca-proc-service-template
to aid orchestration of CWL application packages running in Kubernetes via Calrissian - pycalrissian - Python library used by
zoo-calrissian-runner
to aid interfacing with Calrissian and Kubernetes
- Application Hub - [repository] [docs]:
- ApplicationHub Applications:
- Processor Development Environment [repository]
- JupyterLab [repository]
- Remote Desktop [repository]
- Remote Desktop with QGIS [repository]
- Remote Desktop with SNAP [repository]
- Dashboard with Streamlit [repository]
- ApplicationHub Applications:
- Resource Catalogue - [repository] - [docs]
- Data Access - [repository] - [docs]
- Registration API - [repository] - [docs]
- Workspace API - [repository] - [docs]
- Minio Bucket API - repository - docs
- Identity & Access Management...
- Keycloak Solution (NEW)
- Gluu Solution (deprecated)