A react web application for Alibaba product scrapping
This project is a web scraper built with Node.js for the backend. It is designed to scrape data from Alibaba, providing a convenient way to gather information from the platform.
-
Web Scraping: The application uses a headless browser to scrape data from Alibaba. It can extract information such as product details, prices, and ratings.
-
Node.js Backend: The backend is powered by Node.js, handling the scraping logic and serving the data.
Before running the project, ensure that you have the following installed:
- Node.js and npm
-
Clone the repository:
git clone https://github.com/syedissambukhari/Alibaba-scrapper-using-NodeJs.git
1.Navigate to the project folder:
cd Alibaba-scrapper-using-NodeJs 2.Install dependencies: npm install
1.Web Scraper Settings:
Open config.js and configure the scraper settings such as the URL to scrape, selectors, etc.
javascript
module.exports = { url: 'your-alibaba-url', // Other configuration options };
Modify the configuration according to your scraping requirements.
2.Run the Application:
Start the Node.js server:
npm start The application should now be running. Access it at http://localhost:3000 in your web browser.
Open the application in your web browser.
Enter the necessary parameters or click the "Scrape" button to initiate the scraping process.
View the scraped data on the console or modify the application to display it on a web interface.