From 4e93c084adc0e0a36b887392cc68fff7ae03007b Mon Sep 17 00:00:00 2001 From: Siddharth Kekre <40489787+iSiddharth20@users.noreply.github.com> Date: Tue, 23 Apr 2024 15:20:06 -0700 Subject: [PATCH] Corrected Visual Representation of Data Transformation --- README.md | 10 ++++++++-- 1 file changed, 8 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 723ce38..4f64d37 100644 --- a/README.md +++ b/README.md @@ -10,6 +10,8 @@ Exploring the forefront of generative AI to enhance video quality through advanc This project is a novel approach to enhance video resolution both spatially and temporally using generative AI techniques. By leveraging Auto-Encoders and LSTM Networks, the project aims to interpolate high-temporal-resolution grayscale images and colorize them by learning from a corresponding set of RGB images, ultimately achieving high-fidelity video super-resolution. #### Checkout the Latest Stable Release [Here](https://github.com/iSiddharth20/Generative-AI-Based-Spatio-Temporal-Fusion/releases) +#### Checkout the Video Demonstration of Proposed Methodology [Here](https://github.com/iSiddharth20/Generative-AI-Based-Spatio-Temporal-Fusion/issues/27) + ## Research Objective @@ -19,8 +21,12 @@ The main goals of the project are: Here's a visual representation of the data transformation: -- **Current Format**: ` [Grey-1] [Grey-2, RGB-2] [Grey-3] [Grey-4] ... [Grey-8, RGB-8] [Grey-9] [Grey-10]` -- **Post-Processing**: `[RGB-1] [RGB-1.5] [RGB-2] [RGB-2.5] ... [RGB-8.5] [RGB-9] [RGB-9.5] [RGB-10]` +- During Training : + - **Input**: ` [Grey-1] [Grey-2, RGB-2] [Grey-3] [Grey-4, RGB-4] ... [Grey-8, RGB-8] [Grey-9] [Grey-10, RGB-10]` + - **Targeted Output**: `[RGB-1] [RGB-2] [RGB-3] ... [RGB-8] [RGB-9] [RGB-10]` +- During Inference : + - **Input**: ` [Grey-1] [Grey-2] [Grey-3] [Grey-4] ... [Grey-8] [Grey-9] [Grey-10]` + - **Expected Output**: `[RGB-1] [RGB-1.5] [RGB-2] [RGB-2.5] ... [RGB-8.5] [RGB-9] [RGB-9.5] [RGB-10]` ## Resource Links