Skip to content
Minh Pham edited this page Jun 15, 2020 · 11 revisions

Welcome to the MINT-Transformation wiki!

A framework to construct a transformation pipeline based on a given specifications

Our framework can incoporate general transformation libraries (e.g. GDAL, xarray) in form of wrapper functions and perform these implemented transformation operations. For instance, we already imported Topoflow transformation notebook in our system.

Our framework also allows users to write format-independent transformation functions with the help of D-REPR. MINT-Transformation takes care of reading and writing data from/to different data formats while users can implement the transformations using a common graph-like representation.

MINT-Transformation currently support data streaming, which allows the pipelines to be run against large datasets of multiple TBs.