-
Notifications
You must be signed in to change notification settings - Fork 1
Home
Minh Pham edited this page Jun 15, 2020
·
11 revisions
Our framework can incoporate general transformation libraries (e.g. GDAL, xarray) in form of wrapper functions and perform these implemented transformation operations. For instance, we already imported Topoflow transformation notebook in our system.
Our framework also allows users to write format-independent transformation functions with the help of D-REPR. MINT-Transformation takes care of reading and writing data from/to different data formats while users can implement the transformations using a common graph-like representation.
MINT-Transformation currently support data streaming, which allows the pipelines to be run against large datasets of multiple TBs.