Checkout our Devpost!
Tired of spending hours formatting Word docs to make it perfect just to have a simple resize change all the output? Our app takes in your images and outputs a perfect pdf using ML and Binning Algos!
We were tired of often spending more time merging together multiple screenshots of lecture slides into the ultimate cheatsheet than spending time actually studying. Putting to them into MS Word and formatting would inevitably lead to:
We decided to use CNN to obtain the font size of texts on screenshots and a 2D bin packing algorithm -- 2 Phase Bin Packing Hybrid First Fit Algorithm .
- The user inputs a series of images
- As we need to make sure that each optimally resized image is still readable to the user, we run a text detection algorithm making use of CNN in order to output bounding boxes around each word. We use this as a proxy for font size of images. We output a score for the size of words on each image
- We resize images according to the scoring to make sure that all images ar approximately the same font size and are readable to the user
- We merge all images into a pdf using a two phase binning algorithm in order to output images in the most space efficient manner
Code, tears and guttural screams
We run the text detection and resizing in Python on a Flask Server using OpenCV. We have a React- Native front end and a Node.js backend. The user inputs the images which then triggers the text detection algorithm to run in python. We then run the binning algorithm in Node to pack all the images together.
We emphasised a clean and functional UI, that is both easy to use and appealing to the user-- and so we adopted a UI style called neumorphism.