This is a Python web project that uses Flask web framework to scrape data from Jumia and Tonaton websites, make comparisons of product before proceeding to purchasing site. The project includes two custom API files (jumia_api.py and tonaton_api.py) that make requests to the two servers, parse the response and retrieve data based on a user-defined search keyword.
- Python 3.6
- Flask 1.1.2
- Requests library
- BeautifulSoup4 library 4.9.3
- Clone the repository to your local machine
- Navigate to the root directory of the project in your terminal or command prompt.
- Run
pip install -r requirements.txtto install the required dependencies.
- Run
export FLASK_APP=main.pyon Linux/MacOS orset FLASK_APP=main.pyon Windows to set the FLASK_APP environment variable to the name of the main Flask application file. - Run
flask runto start the application. - Open your web browser and navigate to
http://localhost:5000
The application uses two APIs to fetch the search results:
The jumia_api.py file defines a jumia function that takes a search term as input and returns a list of dictionaries representing the search results from the Jumia website. Each dictionary contains the following keys:
title: The title of the product.price: The price of the product.prod_link: The link to the product page.thumbnail_link: The link to the product image.
The tonaton_api.py file defines a tonaton function that takes a search term as input and returns a list of dictionaries representing the search results from the Tonaton website. Each dictionary contains the following keys:
title: The title of the product.price: The price of the product.location: The location of the seller.prod_link: The link to the product page.thumbnail_link: The link to the product image.
- Enter a search query in the search box and click the "Search" button
- The application will retrieve and display up to 10 results each from Jumia and Tonaton websites based on the search query